See 
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/1594/display/redirect?page=changes>

Changes:

[bhulette] Fix inverted timeout check in TestPubsub

[bhulette] Add empty check before acknowledge


------------------------------------------
[...truncated 1.32 MB...]
19/11/21 17:18:45 INFO sdk_worker.create_state_handler: State channel 
established.
19/11/21 17:18:45 INFO data_plane.create_data_channel: Creating client data 
channel for localhost:40915
19/11/21 17:18:45 INFO 
org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client 
connected.
19/11/21 17:18:45 INFO 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing 
environment urn: "beam:env:process:v1"
payload: 
"\032\202\001<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh";>

19/11/21 17:18:45 INFO sdk_worker.run: No more requests from control plane
19/11/21 17:18:45 INFO sdk_worker.run: SDK Harness waiting for in-flight 
requests to complete
19/11/21 17:18:45 INFO data_plane.close: Closing all cached grpc data channels.
19/11/21 17:18:45 INFO sdk_worker.close: Closing all cached gRPC state handlers.
19/11/21 17:18:45 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: 
Hanged up for unknown endpoint.
19/11/21 17:18:45 INFO sdk_worker.run: Done consuming work.
19/11/21 17:18:45 INFO sdk_worker_main.main: Python sdk harness exiting.
19/11/21 17:18:45 INFO 
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Logging client 
hanged up.
19/11/21 17:18:45 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: 
Hanged up for unknown endpoint.
19/11/21 17:18:45 INFO 
org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: 
GetManifest for 
/tmp/sparktestS4RsrF/job_bd826526-6af5-48f8-ac7a-edefdb3560ce/MANIFEST
19/11/21 17:18:45 INFO 
org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: 
GetManifest for 
/tmp/sparktestS4RsrF/job_bd826526-6af5-48f8-ac7a-edefdb3560ce/MANIFEST -> 0 
artifacts
19/11/21 17:18:46 INFO 
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging 
client connected.
19/11/21 17:18:46 INFO sdk_worker_main.main: Logging handler created.
19/11/21 17:18:46 INFO sdk_worker_main.start: Status HTTP server running at 
localhost:36065
19/11/21 17:18:46 INFO sdk_worker_main.main: semi_persistent_directory: /tmp
19/11/21 17:18:46 WARN sdk_worker_main._load_main_session: No session file 
found: /tmp/staged/pickled_main_session. Functions defined in __main__ 
(interactive session) may fail. 
19/11/21 17:18:46 WARN pipeline_options.get_all_options: Discarding unparseable 
args: [u'--job_server_timeout=60', 
u'--app_name=test_windowing_1574356723.69_77af0195-db27-430e-9077-1dcbb6ae0f83',
 u'--direct_runner_use_stacked_bundle', u'--spark_master=local', 
u'--options_id=30', u'--enable_spark_metric_sinks', u'--pipeline_type_check'] 
19/11/21 17:18:46 INFO sdk_worker_main.main: Python sdk harness started with 
pipeline_options: {'runner': u'None', 'experiments': [u'beam_fn_api'], 
'environment_cache_millis': u'0', 'environment_type': u'PROCESS', 
'sdk_location': u'container', 'job_name': u'test_windowing_1574356723.69', 
'environment_config': u'{"command": 
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh"}',>
 'sdk_worker_parallelism': u'1', 'job_endpoint': u'localhost:40919'}
19/11/21 17:18:46 INFO statecache.__init__: Creating state cache with size 0
19/11/21 17:18:46 INFO sdk_worker.__init__: Creating insecure control channel 
for localhost:38111.
19/11/21 17:18:46 INFO sdk_worker.__init__: Control channel established.
19/11/21 17:18:46 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam 
Fn Control client connected with id 262-1
19/11/21 17:18:46 INFO sdk_worker.__init__: Initializing SDKHarness with 
unbounded number of workers.
19/11/21 17:18:46 INFO sdk_worker.create_state_handler: Creating insecure state 
channel for localhost:40847.
19/11/21 17:18:46 INFO sdk_worker.create_state_handler: State channel 
established.
19/11/21 17:18:46 INFO data_plane.create_data_channel: Creating client data 
channel for localhost:39805
19/11/21 17:18:46 INFO 
org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client 
connected.
19/11/21 17:18:46 INFO 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing 
environment urn: "beam:env:process:v1"
payload: 
"\032\202\001<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh";>

19/11/21 17:18:46 INFO sdk_worker.run: No more requests from control plane
19/11/21 17:18:46 INFO sdk_worker.run: SDK Harness waiting for in-flight 
requests to complete
19/11/21 17:18:46 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: 
Hanged up for unknown endpoint.
19/11/21 17:18:46 INFO data_plane.close: Closing all cached grpc data channels.
19/11/21 17:18:46 INFO sdk_worker.close: Closing all cached gRPC state handlers.
19/11/21 17:18:46 INFO sdk_worker.run: Done consuming work.
19/11/21 17:18:46 INFO sdk_worker_main.main: Python sdk harness exiting.
19/11/21 17:18:46 INFO 
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Logging client 
hanged up.
19/11/21 17:18:46 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: 
Hanged up for unknown endpoint.
19/11/21 17:18:46 INFO 
org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: 
GetManifest for 
/tmp/sparktestS4RsrF/job_bd826526-6af5-48f8-ac7a-edefdb3560ce/MANIFEST
19/11/21 17:18:46 INFO 
org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: 
GetManifest for 
/tmp/sparktestS4RsrF/job_bd826526-6af5-48f8-ac7a-edefdb3560ce/MANIFEST -> 0 
artifacts
19/11/21 17:18:46 INFO 
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging 
client connected.
19/11/21 17:18:46 INFO sdk_worker_main.main: Logging handler created.
19/11/21 17:18:46 INFO sdk_worker_main.start: Status HTTP server running at 
localhost:46105
19/11/21 17:18:46 INFO sdk_worker_main.main: semi_persistent_directory: /tmp
19/11/21 17:18:46 WARN sdk_worker_main._load_main_session: No session file 
found: /tmp/staged/pickled_main_session. Functions defined in __main__ 
(interactive session) may fail. 
19/11/21 17:18:46 WARN pipeline_options.get_all_options: Discarding unparseable 
args: [u'--job_server_timeout=60', 
u'--app_name=test_windowing_1574356723.69_77af0195-db27-430e-9077-1dcbb6ae0f83',
 u'--direct_runner_use_stacked_bundle', u'--spark_master=local', 
u'--options_id=30', u'--enable_spark_metric_sinks', u'--pipeline_type_check'] 
19/11/21 17:18:46 INFO sdk_worker_main.main: Python sdk harness started with 
pipeline_options: {'runner': u'None', 'experiments': [u'beam_fn_api'], 
'environment_cache_millis': u'0', 'environment_type': u'PROCESS', 
'sdk_location': u'container', 'job_name': u'test_windowing_1574356723.69', 
'environment_config': u'{"command": 
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh"}',>
 'sdk_worker_parallelism': u'1', 'job_endpoint': u'localhost:40919'}
19/11/21 17:18:46 INFO statecache.__init__: Creating state cache with size 0
19/11/21 17:18:46 INFO sdk_worker.__init__: Creating insecure control channel 
for localhost:38629.
19/11/21 17:18:46 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam 
Fn Control client connected with id 263-1
19/11/21 17:18:46 INFO sdk_worker.__init__: Control channel established.
19/11/21 17:18:46 INFO sdk_worker.__init__: Initializing SDKHarness with 
unbounded number of workers.
19/11/21 17:18:46 INFO sdk_worker.create_state_handler: Creating insecure state 
channel for localhost:37415.
19/11/21 17:18:46 INFO sdk_worker.create_state_handler: State channel 
established.
19/11/21 17:18:46 INFO data_plane.create_data_channel: Creating client data 
channel for localhost:37657
19/11/21 17:18:46 INFO 
org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client 
connected.
19/11/21 17:18:47 INFO 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing 
environment urn: "beam:env:process:v1"
payload: 
"\032\202\001<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh";>

19/11/21 17:18:47 INFO sdk_worker.run: No more requests from control plane
19/11/21 17:18:47 INFO sdk_worker.run: SDK Harness waiting for in-flight 
requests to complete
19/11/21 17:18:47 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: 
Hanged up for unknown endpoint.
19/11/21 17:18:47 INFO data_plane.close: Closing all cached grpc data channels.
19/11/21 17:18:47 INFO sdk_worker.close: Closing all cached gRPC state handlers.
19/11/21 17:18:47 INFO sdk_worker.run: Done consuming work.
19/11/21 17:18:47 INFO sdk_worker_main.main: Python sdk harness exiting.
19/11/21 17:18:47 INFO 
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Logging client 
hanged up.
19/11/21 17:18:47 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: 
Hanged up for unknown endpoint.
19/11/21 17:18:47 INFO 
org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: 
GetManifest for 
/tmp/sparktestS4RsrF/job_bd826526-6af5-48f8-ac7a-edefdb3560ce/MANIFEST
19/11/21 17:18:47 INFO 
org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: 
GetManifest for 
/tmp/sparktestS4RsrF/job_bd826526-6af5-48f8-ac7a-edefdb3560ce/MANIFEST -> 0 
artifacts
19/11/21 17:18:47 INFO 
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging 
client connected.
19/11/21 17:18:47 INFO sdk_worker_main.main: Logging handler created.
19/11/21 17:18:47 INFO sdk_worker_main.start: Status HTTP server running at 
localhost:35467
19/11/21 17:18:47 INFO sdk_worker_main.main: semi_persistent_directory: /tmp
19/11/21 17:18:47 WARN sdk_worker_main._load_main_session: No session file 
found: /tmp/staged/pickled_main_session. Functions defined in __main__ 
(interactive session) may fail. 
19/11/21 17:18:47 WARN pipeline_options.get_all_options: Discarding unparseable 
args: [u'--job_server_timeout=60', 
u'--app_name=test_windowing_1574356723.69_77af0195-db27-430e-9077-1dcbb6ae0f83',
 u'--direct_runner_use_stacked_bundle', u'--spark_master=local', 
u'--options_id=30', u'--enable_spark_metric_sinks', u'--pipeline_type_check'] 
19/11/21 17:18:47 INFO sdk_worker_main.main: Python sdk harness started with 
pipeline_options: {'runner': u'None', 'experiments': [u'beam_fn_api'], 
'environment_cache_millis': u'0', 'environment_type': u'PROCESS', 
'sdk_location': u'container', 'job_name': u'test_windowing_1574356723.69', 
'environment_config': u'{"command": 
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh"}',>
 'sdk_worker_parallelism': u'1', 'job_endpoint': u'localhost:40919'}
19/11/21 17:18:47 INFO statecache.__init__: Creating state cache with size 0
19/11/21 17:18:47 INFO sdk_worker.__init__: Creating insecure control channel 
for localhost:34583.
19/11/21 17:18:47 INFO sdk_worker.__init__: Control channel established.
19/11/21 17:18:47 INFO sdk_worker.__init__: Initializing SDKHarness with 
unbounded number of workers.
19/11/21 17:18:47 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam 
Fn Control client connected with id 264-1
19/11/21 17:18:47 INFO sdk_worker.create_state_handler: Creating insecure state 
channel for localhost:39653.
19/11/21 17:18:47 INFO sdk_worker.create_state_handler: State channel 
established.
19/11/21 17:18:47 INFO data_plane.create_data_channel: Creating client data 
channel for localhost:45493
19/11/21 17:18:47 INFO 
org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client 
connected.
19/11/21 17:18:47 INFO 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing 
environment urn: "beam:env:process:v1"
payload: 
"\032\202\001<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh";>

19/11/21 17:18:47 INFO sdk_worker.run: No more requests from control plane
19/11/21 17:18:47 INFO sdk_worker.run: SDK Harness waiting for in-flight 
requests to complete
19/11/21 17:18:47 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: 
Hanged up for unknown endpoint.
19/11/21 17:18:47 INFO data_plane.close: Closing all cached grpc data channels.
19/11/21 17:18:47 INFO sdk_worker.close: Closing all cached gRPC state handlers.
19/11/21 17:18:47 INFO sdk_worker.run: Done consuming work.
19/11/21 17:18:47 INFO sdk_worker_main.main: Python sdk harness exiting.
19/11/21 17:18:47 INFO 
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Logging client 
hanged up.
19/11/21 17:18:47 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: 
Hanged up for unknown endpoint.
19/11/21 17:18:47 INFO 
org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: 
GetManifest for 
/tmp/sparktestS4RsrF/job_bd826526-6af5-48f8-ac7a-edefdb3560ce/MANIFEST
19/11/21 17:18:47 INFO 
org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: 
GetManifest for 
/tmp/sparktestS4RsrF/job_bd826526-6af5-48f8-ac7a-edefdb3560ce/MANIFEST -> 0 
artifacts
19/11/21 17:18:48 INFO 
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging 
client connected.
19/11/21 17:18:48 INFO sdk_worker_main.main: Logging handler created.
19/11/21 17:18:48 INFO sdk_worker_main.start: Status HTTP server running at 
localhost:43519
19/11/21 17:18:48 INFO sdk_worker_main.main: semi_persistent_directory: /tmp
19/11/21 17:18:48 WARN sdk_worker_main._load_main_session: No session file 
found: /tmp/staged/pickled_main_session. Functions defined in __main__ 
(interactive session) may fail. 
19/11/21 17:18:48 WARN pipeline_options.get_all_options: Discarding unparseable 
args: [u'--job_server_timeout=60', 
u'--app_name=test_windowing_1574356723.69_77af0195-db27-430e-9077-1dcbb6ae0f83',
 u'--direct_runner_use_stacked_bundle', u'--spark_master=local', 
u'--options_id=30', u'--enable_spark_metric_sinks', u'--pipeline_type_check'] 
19/11/21 17:18:48 INFO sdk_worker_main.main: Python sdk harness started with 
pipeline_options: {'runner': u'None', 'experiments': [u'beam_fn_api'], 
'environment_cache_millis': u'0', 'environment_type': u'PROCESS', 
'sdk_location': u'container', 'job_name': u'test_windowing_1574356723.69', 
'environment_config': u'{"command": 
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh"}',>
 'sdk_worker_parallelism': u'1', 'job_endpoint': u'localhost:40919'}
19/11/21 17:18:48 INFO statecache.__init__: Creating state cache with size 0
19/11/21 17:18:48 INFO sdk_worker.__init__: Creating insecure control channel 
for localhost:39787.
19/11/21 17:18:48 INFO 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam 
Fn Control client connected with id 265-1
19/11/21 17:18:48 INFO sdk_worker.__init__: Control channel established.
19/11/21 17:18:48 INFO sdk_worker.__init__: Initializing SDKHarness with 
unbounded number of workers.
19/11/21 17:18:48 INFO sdk_worker.create_state_handler: Creating insecure state 
channel for localhost:33141.
19/11/21 17:18:48 INFO sdk_worker.create_state_handler: State channel 
established.
19/11/21 17:18:48 INFO data_plane.create_data_channel: Creating client data 
channel for localhost:44665
19/11/21 17:18:48 INFO 
org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client 
connected.
19/11/21 17:18:48 INFO 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing 
environment urn: "beam:env:process:v1"
payload: 
"\032\202\001<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh";>

19/11/21 17:18:48 INFO sdk_worker.run: No more requests from control plane
19/11/21 17:18:48 INFO sdk_worker.run: SDK Harness waiting for in-flight 
requests to complete
19/11/21 17:18:48 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: 
Hanged up for unknown endpoint.
19/11/21 17:18:48 INFO data_plane.close: Closing all cached grpc data channels.
19/11/21 17:18:48 INFO sdk_worker.close: Closing all cached gRPC state handlers.
19/11/21 17:18:48 INFO sdk_worker.run: Done consuming work.
19/11/21 17:18:48 INFO sdk_worker_main.main: Python sdk harness exiting.
19/11/21 17:18:48 INFO 
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Logging client 
hanged up.
19/11/21 17:18:48 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: 
Hanged up for unknown endpoint.
19/11/21 17:18:48 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job 
test_windowing_1574356723.69_77af0195-db27-430e-9077-1dcbb6ae0f83 finished.
19/11/21 17:18:48 WARN 
org.apache.beam.runners.spark.SparkPipelineResult$BatchMode: Collecting 
monitoring infos is not implemented yet in Spark portable runner.
19/11/21 17:18:48 INFO 
org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: 
Manifest at 
/tmp/sparktestS4RsrF/job_bd826526-6af5-48f8-ac7a-edefdb3560ce/MANIFEST has 0 
artifact locations
19/11/21 17:18:48 INFO 
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService:
 Removed dir /tmp/sparktestS4RsrF/job_bd826526-6af5-48f8-ac7a-edefdb3560ce/
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
.
======================================================================
ERROR: test_pardo_state_with_custom_key_coder (__main__.SparkRunnerTest)
Tests that state requests work correctly when the key coder is an
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/portable_runner_test.py", line 231, in 
test_pardo_state_with_custom_key_coder
    equal_to(expected))
  File "apache_beam/pipeline.py", line 436, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 428, in 
wait_until_finish
    for state_response in self._state_stream:
  File 
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
 line 395, in next
    return self._next()
  File 
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
 line 552, in _next
    _common.wait(self._state.condition.wait, _response_ready)
  File 
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_common.py";,>
 line 140, in wait
    _wait_once(wait_fn, MAXIMUM_WAIT_TIMEOUT, spin_cb)
  File 
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_common.py";,>
 line 105, in _wait_once
    wait_fn(timeout=timeout)
  File "/usr/lib/python2.7/threading.py", line 359, in wait
    _sleep(delay)
  File "apache_beam/runners/portability/portable_runner_test.py", line 75, in 
handler
    raise BaseException(msg)
BaseException: Timed out after 60 seconds.

======================================================================
ERROR: test_pardo_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
==================== Timed out after 60 seconds. ====================

# Thread: <Thread(wait_until_finish_read, started daemon 139821385250560)>

  File "apache_beam/runners/portability/fn_api_runner_test.py", line 328, in 
test_pardo_timers
    assert_that(actual, equal_to(expected))
  File "apache_beam/pipeline.py", line 436, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 428, in 
wait_until_finish
    for state_response in self._state_stream:
  File 
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
 line 395, in next
    return self._next()
  File 
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,>
 line 552, in _next
# Thread: <Thread(Thread-118, started daemon 139821467653888)>

# Thread: <_MainThread(MainThread, started 139822246885120)>
==================== Timed out after 60 seconds. ====================

# Thread: <Thread(wait_until_finish_read, started daemon 139821368465152)>

# Thread: <Thread(Thread-124, started daemon 139821360072448)>

# Thread: <_MainThread(MainThread, started 139822246885120)>
    _common.wait(self._state.condition.wait, _response_ready)
  File 
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_common.py";,>
 line 140, in wait
    _wait_once(wait_fn, MAXIMUM_WAIT_TIMEOUT, spin_cb)
  File 
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_common.py";,>
 line 105, in _wait_once
    wait_fn(timeout=timeout)
  File "/usr/lib/python2.7/threading.py", line 359, in wait
    _sleep(delay)
  File "apache_beam/runners/portability/portable_runner_test.py", line 75, in 
handler
    raise BaseException(msg)
BaseException: Timed out after 60 seconds.

======================================================================
ERROR: test_sdf_with_watermark_tracking (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 499, in 
test_sdf_with_watermark_tracking
    assert_that(actual, equal_to(list(''.join(data))))
  File "apache_beam/pipeline.py", line 436, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 438, in 
wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline 
test_sdf_with_watermark_tracking_1574356714.93_a60d8690-8832-42a7-a591-0c1bee2ca0c3
 failed in state FAILED: java.lang.UnsupportedOperationException: The 
ActiveBundle does not have a registered bundle checkpoint handler.

----------------------------------------------------------------------
Ran 38 tests in 297.043s

FAILED (errors=3, skipped=9)

> Task :sdks:python:test-suites:portable:py2:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file 
'<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build.gradle'>
 line: 198

* What went wrong:
Execution failed for task 
':sdks:python:test-suites:portable:py2:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug 
option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See 
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 32s
60 actionable tasks: 47 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/dwoqpv33j5p64

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to