See
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/4778/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13015] Add state caching capability to be used as hint for
runners
------------------------------------------
[...truncated 33.32 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
akka.dispatch.Mailbox.run(Mailbox.scala:225)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
akka.dispatch.Mailbox.exec(Mailbox.scala:235)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\t... 4
more'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Caused
by: java.util.concurrent.ExecutionException: java.lang.RuntimeException: Error
received from SDK harness for instruction 11:
org.apache.beam.sdk.util.UserCodeException:
org.apache.beam.sdk.coders.CoderException: cannot encode a null Iterable'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:39)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1784)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2900(FnApiDoFnRunner.java:144)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.FnApiDoFnRunner$FinishBundleArgumentProvider$Context.output(FnApiDoFnRunner.java:2111)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.sdk.io.jdbc.JdbcIO$1.finish(JdbcIO.java:1459)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.sdk.io.jdbc.JdbcIO$1$DoFnInvoker.invokeFinishBundle(Unknown
Source)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.FnApiDoFnRunner.finishBundle(FnApiDoFnRunner.java:1762)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.data.PTransformFunctionRegistry.lambda$register$0(PTransformFunctionRegistry.java:111)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:489)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:151)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:116)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
java.lang.Thread.run(Thread.java:748)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Caused
by: org.apache.beam.sdk.coders.CoderException: cannot encode a null Iterable'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.sdk.coders.IterableLikeCoder.registerByteSizeObserver(IterableLikeCoder.java:195)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.sdk.coders.IterableLikeCoder.registerByteSizeObserver(IterableLikeCoder.java:60)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$SampleByteSizeDistribution.tryUpdate(PCollectionConsumerRegistry.java:374)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:248)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:209)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:60)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:504)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:555)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:268)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:268)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:519)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:360)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:779)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
java.lang.Thread.run(Thread.java:748)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Caused
by: java.lang.RuntimeException: Error received from SDK harness for instruction
11: org.apache.beam.sdk.util.UserCodeException:
org.apache.beam.sdk.coders.CoderException: cannot encode a null Iterable'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:39)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1784)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2900(FnApiDoFnRunner.java:144)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.FnApiDoFnRunner$FinishBundleArgumentProvider$Context.output(FnApiDoFnRunner.java:2111)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.sdk.io.jdbc.JdbcIO$1.finish(JdbcIO.java:1459)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.sdk.io.jdbc.JdbcIO$1$DoFnInvoker.invokeFinishBundle(Unknown
Source)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.FnApiDoFnRunner.finishBundle(FnApiDoFnRunner.java:1762)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.data.PTransformFunctionRegistry.lambda$register$0(PTransformFunctionRegistry.java:111)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:489)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:151)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:116)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
java.lang.Thread.run(Thread.java:748)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Caused
by: org.apache.beam.sdk.coders.CoderException: cannot encode a null Iterable'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.sdk.coders.IterableLikeCoder.registerByteSizeObserver(IterableLikeCoder.java:195)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.sdk.coders.IterableLikeCoder.registerByteSizeObserver(IterableLikeCoder.java:60)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$SampleByteSizeDistribution.tryUpdate(PCollectionConsumerRegistry.java:374)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:248)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:209)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:318)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:301)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:834)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\t... 1
more'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:20 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl
lambda$getFileCloser$0'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
FileChannelManager removed spill file directory
/tmp/flink-io-34ceec4e-f0a0-4d1c-9142-c078d0fc59e3'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:20 AM org.apache.flink.runtime.io.network.NettyShuffleEnvironment
close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shutting down the network environment and its components.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:20 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl
lambda$getFileCloser$0'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
FileChannelManager removed spill file directory
/tmp/flink-netty-shuffle-b10aea5d-7134-441d-9967-2b62a9f87718'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:20 AM org.apache.flink.runtime.taskexecutor.KvStateService shutdown'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shutting down the kvState service and its components.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:20 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService
stop'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stop job leader service.'
ERROR root:portable_runner.py:570 java.lang.RuntimeException: Error received
from SDK harness for instruction 11:
org.apache.beam.sdk.util.UserCodeException:
org.apache.beam.sdk.coders.CoderException: cannot encode a null Iterable
at
org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:39)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1784)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2900(FnApiDoFnRunner.java:144)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$FinishBundleArgumentProvider$Context.output(FnApiDoFnRunner.java:2111)
at
org.apache.beam.sdk.io.jdbc.JdbcIO$1.finish(JdbcIO.java:1459)
at
org.apache.beam.sdk.io.jdbc.JdbcIO$1$DoFnInvoker.invokeFinishBundle(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.finishBundle(FnApiDoFnRunner.java:1762)
at
org.apache.beam.fn.harness.data.PTransformFunctionRegistry.lambda$register$0(PTransformFunctionRegistry.java:111)
at
org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:489)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:151)
at
org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:116)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by:
org.apache.beam.sdk.coders.CoderException: cannot encode a null Iterable
at
org.apache.beam.sdk.coders.IterableLikeCoder.registerByteSizeObserver(IterableLikeCoder.java:195)
at
org.apache.beam.sdk.coders.IterableLikeCoder.registerByteSizeObserver(IterableLikeCoder.java:60)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$SampleByteSizeDistribution.tryUpdate(PCollectionConsumerRegistry.java:374)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:248)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:209)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:20 AM org.apache.flink.runtime.filecache.FileCache shutdown'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
removed file cache directory
/tmp/flink-dist-cache-a810a0cf-6b9f-473b-969f-a1b0a7a89062'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:20 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
handleOnStopException'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:20 AM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint
lambda$shutDownInternal$5'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Removing cache directory /tmp/flink-web-ui'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:21 AM org.apache.flink.runtime.rest.RestServerEndpoint
lambda$closeAsync$1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shut down complete.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:21 AM org.apache.flink.runtime.resourcemanager.ResourceManager
deregisterApplication'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shut down cluster because application is in CANCELED, diagnostics
DispatcherResourceManagerComponent has been closed..'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:21 AM
org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent
closeAsyncInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Closing components.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:21 AM
org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess
closeInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping SessionDispatcherLeaderProcess.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:21 AM org.apache.flink.runtime.dispatcher.Dispatcher onStop'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping dispatcher akka://flink/user/rpc/dispatcher_2.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:21 AM org.apache.flink.runtime.dispatcher.Dispatcher
terminateRunningJobs'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping all currently running jobs of dispatcher
akka://flink/user/rpc/dispatcher_2.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:21 AM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Closing the slot manager.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:21 AM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
suspend'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Suspending the slot manager.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:21 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$0'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped dispatcher akka://flink/user/rpc/dispatcher_2.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:21 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping Akka RPC service.'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:576
Job state changed to FAILED
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:21 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping Akka RPC service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:21 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
lambda$stopService$7'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped Akka RPC service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:21 AM org.apache.flink.runtime.blob.AbstractBlobCache close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shutting down BLOB cache'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:21 AM org.apache.flink.runtime.blob.AbstractBlobCache close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shutting down BLOB cache'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:21 AM org.apache.flink.runtime.blob.BlobServer close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped BLOB server at 0.0.0.0:37549'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jan 19,
2022 6:28:21 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
lambda$stopService$7'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped Akka RPC service.'
=============================== warnings summary ===============================
apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_iobase_source
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_iobase_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2437:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_iobase_source
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_iobase_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2439:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_iobase_source
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_iobase_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2470:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
| _PassThroughThenCleanup(files_to_remove_pcoll))
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_column_selection
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_column_selection_and_row_restriction
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_native_datetime
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_query
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_query_and_filters
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_row_restriction
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_very_selective_filters
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2481:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
project_id = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_column_selection
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_column_selection_and_row_restriction
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_native_datetime
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_query
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_query_and_filters
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_row_restriction
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_very_selective_filters
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2509:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
| _PassThroughThenCleanupTempDatasets(project_to_cleanup_pcoll))
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-flink-py37.xml>
-
======== 1 failed, 14 passed, 4 skipped, 22 warnings in 823.12 seconds =========
> Task :sdks:python:test-suites:dataflow:py37:postCommitIT
[gw2] [32mPASSED[0m
apache_beam/examples/complete/juliaset/juliaset/juliaset_test_it.py::JuliaSetTestIT::test_run_example_with_setup_file
apache_beam/io/gcp/big_query_query_to_table_it_test.py::BigQueryQueryToTableIT::test_big_query_legacy_sql
> Task :sdks:python:test-suites:portable:py37:postCommitPy37IT FAILED
> Task :sdks:python:test-suites:portable:py37:xlangSpannerIOIT
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/usr/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 651, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 634, in _read_inputs
for elements in elements_iterator:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
line 426, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string =
"{"created":"@1642574201.344079535","description":"Error received from peer
ipv4:127.0.0.1:40191","file":"src/core/lib/surface/call.cc","file_line":1074,"grpc_message":"Multiplexer
hanging up","grpc_status":1}"
>
> Task :sdks:python:test-suites:dataflow:py37:spannerioIT
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 285
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py37:postCommitPy37IT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 22m 11s
222 actionable tasks: 181 executed, 35 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/ndmydcyntte3k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
