See
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/2312/display/redirect>
Changes:
------------------------------------------
[...truncated 455.25 KB...]
Caused by: java.lang.RuntimeException: Error received from SDK harness for
instruction 6: Traceback (most recent call last):
File "apache_beam/runners/worker/sdk_worker.py", line 185, in _execute
response = task()
File "apache_beam/runners/worker/sdk_worker.py", line 242, in <lambda>
lambda: self.create_worker().do_instruction(request), request)
File "apache_beam/runners/worker/sdk_worker.py", line 378, in do_instruction
getattr(request, request_type), request.instruction_id)
File "apache_beam/runners/worker/sdk_worker.py", line 413, in process_bundle
bundle_processor.process_bundle(instruction_id))
File "apache_beam/runners/worker/bundle_processor.py", line 839, in
process_bundle
input_op_by_transform_id[data.transform_id].process_encoded(data.data)
File "apache_beam/runners/worker/bundle_processor.py", line 216, in
process_encoded
self.output(decoded_value)
File "apache_beam/runners/worker/operations.py", line 326, in output
cython.cast(Receiver, self.receivers[output_index]).receive(windowed_value)
File "apache_beam/runners/worker/operations.py", line 190, in receive
self.consumer.process(windowed_value)
File "apache_beam/runners/worker/operations.py", line 773, in process
delayed_application = self.dofn_runner.process_with_sized_restriction(o)
File "apache_beam/runners/common.py", line 917, in
process_with_sized_restriction
restriction))
File "apache_beam/runners/common.py", line 665, in invoke_process
windowed_value, additional_args, additional_kwargs)
File "apache_beam/runners/common.py", line 766, in _invoke_process_per_window
self.threadsafe_restriction_tracker.check_done()
File "apache_beam/runners/sdf_utils.py", line 112, in check_done
return self._restriction_tracker.check_done()
File "apache_beam/io/restriction_trackers.py", line 101, in check_done
self._range.stop))
ValueError: OffsetRestrictionTracker is not done since work in range [0, 6) has
not been claimed.
at
org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
at
org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:140)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:251)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:309)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:292)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:782)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
... 3 more
20/02/12 12:13:04 WARN
org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService: Failed to
remove job staging directory for token
{"sessionId":"job_7430fb68-7ba4-4f25-a2e2-4f1e7f9a3afd","basePath":"/tmp/sparktestNvch29"}:
{}
java.io.FileNotFoundException:
/tmp/sparktestNvch29/job_7430fb68-7ba4-4f25-a2e2-4f1e7f9a3afd/MANIFEST (No such
file or directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.<init>(FileInputStream.java:138)
at org.apache.beam.sdk.io.LocalFileSystem.open(LocalFileSystem.java:118)
at org.apache.beam.sdk.io.LocalFileSystem.open(LocalFileSystem.java:82)
at org.apache.beam.sdk.io.FileSystems.open(FileSystems.java:252)
at
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService.loadManifest(BeamFileSystemArtifactRetrievalService.java:88)
at
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:92)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobServerDriver.lambda$createJobService$0(JobServerDriver.java:63)
at
org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService.lambda$run$0(InMemoryJobService.java:245)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.setState(JobInvocation.java:246)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.access$200(JobInvocation.java:48)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation$1.onFailure(JobInvocation.java:150)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1052)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
ERROR:root:java.lang.RuntimeException: Error received from SDK harness for
instruction 6: Traceback (most recent call last):
File "apache_beam/runners/worker/sdk_worker.py", line 185, in _execute
response = task()
File "apache_beam/runners/worker/sdk_worker.py", line 242, in <lambda>
lambda: self.create_worker().do_instruction(request), request)
File "apache_beam/runners/worker/sdk_worker.py", line 378, in do_instruction
getattr(request, request_type), request.instruction_id)
File "apache_beam/runners/worker/sdk_worker.py", line 413, in process_bundle
bundle_processor.process_bundle(instruction_id))
File "apache_beam/runners/worker/bundle_processor.py", line 839, in
process_bundle
input_op_by_transform_id[data.transform_id].process_encoded(data.data)
File "apache_beam/runners/worker/bundle_processor.py", line 216, in
process_encoded
self.output(decoded_value)
File "apache_beam/runners/worker/operations.py", line 326, in output
cython.cast(Receiver, self.receivers[output_index]).receive(windowed_value)
File "apache_beam/runners/worker/operations.py", line 190, in receive
self.consumer.process(windowed_value)
File "apache_beam/runners/worker/operations.py", line 773, in process
delayed_application = self.dofn_runner.process_with_sized_restriction(o)
File "apache_beam/runners/common.py", line 917, in
process_with_sized_restriction
restriction))
File "apache_beam/runners/common.py", line 665, in invoke_process
windowed_value, additional_args, additional_kwargs)
File "apache_beam/runners/common.py", line 766, in _invoke_process_per_window
self.threadsafe_restriction_tracker.check_done()
File "apache_beam/runners/sdf_utils.py", line 112, in check_done
return self._restriction_tracker.check_done()
File "apache_beam/io/restriction_trackers.py", line 101, in check_done
self._range.stop))
ValueError: OffsetRestrictionTracker is not done since work in range [0, 6) has
not been claimed.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to FAILED
.sssINFO:apache_beam.runners.portability.fn_api_runner_transforms:====================
<function lift_combiners at 0x7f2239be4758> ====================
20/02/12 12:13:05 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking
job
test_windowed_pardo_state_timers_1581509584.4_cd5f46e5-9fef-4d7a-9f9e-7b523a9622b6
20/02/12 12:13:05 INFO
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job
invocation
test_windowed_pardo_state_timers_1581509584.4_cd5f46e5-9fef-4d7a-9f9e-7b523a9622b6
INFO:apache_beam.runners.portability.portable_runner:Job state changed to
STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to
STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to
RUNNING
20/02/12 12:13:05 INFO org.apache.beam.runners.spark.SparkPipelineRunner:
PipelineOptions.filesToStage was not specified. Defaulting to files from the
classpath
20/02/12 12:13:05 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Will
stage 1 files. (Enable logging at DEBUG level to see which files will be
staged.)
20/02/12 12:13:05 INFO org.apache.beam.runners.spark.SparkPipelineRunner:
Running job
test_windowed_pardo_state_timers_1581509584.4_cd5f46e5-9fef-4d7a-9f9e-7b523a9622b6
on Spark master local
20/02/12 12:13:05 WARN
org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions:
Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not
consistent with equals. That might cause issues on some runners.
20/02/12 12:13:05 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job
test_windowed_pardo_state_timers_1581509584.4_cd5f46e5-9fef-4d7a-9f9e-7b523a9622b6:
Pipeline translated successfully. Computing outputs
20/02/12 12:13:05 INFO
org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService:
GetManifest for __no_artifacts_staged__
20/02/12 12:13:05 INFO
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing
environment urn: "beam:env:process:v1"
payload:
"\032\202\001<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh";>
20/02/12 12:13:05 INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn
Logging clients still connected during shutdown.
20/02/12 12:13:05 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer:
Hanged up for unknown endpoint.
20/02/12 12:13:06 INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging
client connected.
20/02/12 12:13:06 INFO
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:98:
Logging handler created.
20/02/12 12:13:06 INFO
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:79:
Status HTTP server running at localhost:39623
20/02/12 12:13:06 INFO
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:125:
semi_persistent_directory: /tmp
20/02/12 12:13:06 WARN
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:240:
No session file found: /tmp/staged/pickled_main_session. Functions defined in
__main__ (interactive session) may fail.
20/02/12 12:13:06 WARN apache_beam/options/pipeline_options.py:290: Discarding
unparseable args:
[u'--app_name=test_windowed_pardo_state_timers_1581509584.4_cd5f46e5-9fef-4d7a-9f9e-7b523a9622b6',
u'--job_server_timeout=60', u'--pipeline_type_check',
u'--direct_runner_use_stacked_bundle', u'--options_id=29',
u'--enable_spark_metric_sinks']
20/02/12 12:13:06 INFO
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:138:
Python sdk harness started with pipeline_options: {'runner': u'None',
'experiments': [u'beam_fn_api'], 'environment_cache_millis': u'10000',
'artifact_port': u'0', 'environment_type': u'PROCESS', 'sdk_location':
u'container', 'job_name': u'test_windowed_pardo_state_timers_1581509584.4',
'environment_config': u'{"command":
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh"}',>
'expansion_port': u'0', 'spark_master_url': u'local',
'sdk_worker_parallelism': u'1', 'job_endpoint': u'localhost:42779', 'job_port':
u'0'}
20/02/12 12:13:06 INFO apache_beam/runners/worker/statecache.py:154: Creating
state cache with size 0
20/02/12 12:13:06 INFO apache_beam/runners/worker/sdk_worker.py:94: Creating
insecure control channel for localhost:46499.
20/02/12 12:13:06 INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam
Fn Control client connected with id 29-1
20/02/12 12:13:06 INFO apache_beam/runners/worker/sdk_worker.py:102: Control
channel established.
20/02/12 12:13:06 INFO apache_beam/runners/worker/sdk_worker.py:136:
Initializing SDKHarness with unbounded number of workers.
20/02/12 12:13:06 INFO apache_beam/runners/worker/sdk_worker.py:590: Creating
insecure state channel for localhost:37595.
20/02/12 12:13:06 INFO apache_beam/runners/worker/sdk_worker.py:597: State
channel established.
20/02/12 12:13:06 INFO apache_beam/runners/worker/data_plane.py:525: Creating
client data channel for localhost:40723
20/02/12 12:13:06 INFO
org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client
connected.
20/02/12 12:13:07 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job
test_windowed_pardo_state_timers_1581509584.4_cd5f46e5-9fef-4d7a-9f9e-7b523a9622b6
finished.
20/02/12 12:13:07 WARN
org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService: Failed to
remove job staging directory for token
{"sessionId":"job_8c40f3fb-bd15-4fac-9bfa-2125c32c4d66","basePath":"/tmp/sparktestNvch29"}:
{}
java.io.FileNotFoundException:
/tmp/sparktestNvch29/job_8c40f3fb-bd15-4fac-9bfa-2125c32c4d66/MANIFEST (No such
file or directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.<init>(FileInputStream.java:138)
at org.apache.beam.sdk.io.LocalFileSystem.open(LocalFileSystem.java:118)
at org.apache.beam.sdk.io.LocalFileSystem.open(LocalFileSystem.java:82)
at org.apache.beam.sdk.io.FileSystems.open(FileSystems.java:252)
at
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService.loadManifest(BeamFileSystemArtifactRetrievalService.java:88)
at
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:92)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobServerDriver.lambda$createJobService$0(JobServerDriver.java:63)
at
org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService.lambda$run$0(InMemoryJobService.java:245)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.setState(JobInvocation.java:246)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.access$200(JobInvocation.java:48)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:112)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:98)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1058)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
.20/02/12 12:13:08 INFO
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing
environment urn: "beam:env:process:v1"
payload:
"\032\202\001<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh";>
20/02/12 12:13:08 INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn
Logging clients still connected during shutdown.
20/02/12 12:13:08 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer:
Hanged up for unknown endpoint.
INFO:apache_beam.runners.portability.fn_api_runner_transforms:====================
<function lift_combiners at 0x7f2239be4758> ====================
20/02/12 12:13:08 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking
job test_windowing_1581509587.32_8f0195f8-9f1e-499e-b5eb-78d031acf998
20/02/12 12:13:08 INFO
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job
invocation test_windowing_1581509587.32_8f0195f8-9f1e-499e-b5eb-78d031acf998
INFO:apache_beam.runners.portability.portable_runner:Job state changed to
STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to
STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to
RUNNING
20/02/12 12:13:09 INFO org.apache.beam.runners.spark.SparkPipelineRunner:
PipelineOptions.filesToStage was not specified. Defaulting to files from the
classpath
20/02/12 12:13:09 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Will
stage 1 files. (Enable logging at DEBUG level to see which files will be
staged.)
20/02/12 12:13:09 INFO org.apache.beam.runners.spark.SparkPipelineRunner:
Running job test_windowing_1581509587.32_8f0195f8-9f1e-499e-b5eb-78d031acf998
on Spark master local
20/02/12 12:13:09 WARN
org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions:
Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not
consistent with equals. That might cause issues on some runners.
20/02/12 12:13:09 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job
test_windowing_1581509587.32_8f0195f8-9f1e-499e-b5eb-78d031acf998: Pipeline
translated successfully. Computing outputs
20/02/12 12:13:09 INFO
org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService:
GetManifest for __no_artifacts_staged__
20/02/12 12:13:09 INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging
client connected.
20/02/12 12:13:09 INFO
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:98:
Logging handler created.
20/02/12 12:13:09 INFO
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:79:
Status HTTP server running at localhost:36363
20/02/12 12:13:09 INFO
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:125:
semi_persistent_directory: /tmp
20/02/12 12:13:09 WARN
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:240:
No session file found: /tmp/staged/pickled_main_session. Functions defined in
__main__ (interactive session) may fail.
20/02/12 12:13:10 WARN apache_beam/options/pipeline_options.py:290: Discarding
unparseable args:
[u'--app_name=test_windowing_1581509587.32_8f0195f8-9f1e-499e-b5eb-78d031acf998',
u'--job_server_timeout=60', u'--pipeline_type_check',
u'--direct_runner_use_stacked_bundle', u'--options_id=30',
u'--enable_spark_metric_sinks']
20/02/12 12:13:10 INFO
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:138:
Python sdk harness started with pipeline_options: {'runner': u'None',
'experiments': [u'beam_fn_api'], 'environment_cache_millis': u'10000',
'artifact_port': u'0', 'environment_type': u'PROCESS', 'sdk_location':
u'container', 'job_name': u'test_windowing_1581509587.32',
'environment_config': u'{"command":
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh"}',>
'expansion_port': u'0', 'spark_master_url': u'local',
'sdk_worker_parallelism': u'1', 'job_endpoint': u'localhost:42779', 'job_port':
u'0'}
20/02/12 12:13:10 INFO apache_beam/runners/worker/statecache.py:154: Creating
state cache with size 0
20/02/12 12:13:10 INFO apache_beam/runners/worker/sdk_worker.py:94: Creating
insecure control channel for localhost:36915.
20/02/12 12:13:10 INFO apache_beam/runners/worker/sdk_worker.py:102: Control
channel established.
20/02/12 12:13:10 INFO apache_beam/runners/worker/sdk_worker.py:136:
Initializing SDKHarness with unbounded number of workers.
20/02/12 12:13:10 INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam
Fn Control client connected with id 30-1
20/02/12 12:13:10 INFO apache_beam/runners/worker/sdk_worker.py:590: Creating
insecure state channel for localhost:38845.
20/02/12 12:13:10 INFO apache_beam/runners/worker/sdk_worker.py:597: State
channel established.
20/02/12 12:13:10 INFO apache_beam/runners/worker/data_plane.py:525: Creating
client data channel for localhost:34477
20/02/12 12:13:10 INFO
org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client
connected.
20/02/12 12:13:10 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job
test_windowing_1581509587.32_8f0195f8-9f1e-499e-b5eb-78d031acf998 finished.
20/02/12 12:13:10 WARN
org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService: Failed to
remove job staging directory for token
{"sessionId":"job_d7e83e16-5b55-496b-8ecb-3f6e2e005f54","basePath":"/tmp/sparktestNvch29"}:
{}
java.io.FileNotFoundException:
/tmp/sparktestNvch29/job_d7e83e16-5b55-496b-8ecb-3f6e2e005f54/MANIFEST (No such
file or directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.<init>(FileInputStream.java:138)
at org.apache.beam.sdk.io.LocalFileSystem.open(LocalFileSystem.java:118)
at org.apache.beam.sdk.io.LocalFileSystem.open(LocalFileSystem.java:82)
at org.apache.beam.sdk.io.FileSystems.open(FileSystems.java:252)
at
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService.loadManifest(BeamFileSystemArtifactRetrievalService.java:88)
at
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:92)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobServerDriver.lambda$createJobService$0(JobServerDriver.java:63)
at
org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService.lambda$run$0(InMemoryJobService.java:245)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.setState(JobInvocation.java:246)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.access$200(JobInvocation.java:48)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:112)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:98)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1058)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
.
======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 250, in
test_multimap_side_input_type_coercion
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 492, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 468, in
wait_until_finish
(self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_multimap_side_input_type_coercion_1581509523.6_9abc0709-cf7a-4383-9270-5ab20e3a5356
failed in state FAILED: java.io.IOException: No space left on device
----------------------------------------------------------------------
Ran 39 tests in 111.837s
FAILED (errors=1, skipped=10)
> Task :sdks:python:test-suites:portable:py2:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build.gradle'>
line: 248
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py2:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 55s
60 actionable tasks: 47 executed, 13 from cache
Publishing build scan...
https://gradle.com/s/py4jomu3dppve
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
