See
<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/437/display/redirect>
------------------------------------------
[...truncated 2.37 MB...]
[DataSink (DiscardingOutput) (10/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (10/16)
(f97154f998f22f45c9e24433d24445af) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (10/16) (f97154f998f22f45c9e24433d24445af) switched from
DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (10/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (10/16)
(f97154f998f22f45c9e24433d24445af) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (10/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink
(DiscardingOutput) (10/16) (f97154f998f22f45c9e24433d24445af).
[DataSink (DiscardingOutput) (10/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task DataSink (DiscardingOutput) (10/16)
(f97154f998f22f45c9e24433d24445af) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task DataSink
(DiscardingOutput) f97154f998f22f45c9e24433d24445af.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (10/16) (f97154f998f22f45c9e24433d24445af) switched from
RUNNING to FINISHED.
[MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (4/16)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition
(MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (4/16) (edd157c16655a651bf35885f5a23e3e9) switched from RUNNING to
FINISHED.
[MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (4/16)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task
resources for MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (4/16) (edd157c16655a651bf35885f5a23e3e9).
[MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (6/16)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition
(MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (6/16) (9fea6ffbde197d94a3690763986c2c02) switched from RUNNING to
FINISHED.
[MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (6/16)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task
resources for MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (6/16) (9fea6ffbde197d94a3690763986c2c02).
[MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (4/16)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all
FileSystem streams are closed for task MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (4/16) (edd157c16655a651bf35885f5a23e3e9) [FINISHED]
[jobmanager-future-thread-16] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (4/16) (d5f76a39e2c2bd8e9ad90712d49511cf) switched from
CREATED to SCHEDULED.
[MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (6/16)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all
FileSystem streams are closed for task MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (6/16) (9fea6ffbde197d94a3690763986c2c02) [FINISHED]
[jobmanager-future-thread-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (6/16) (bbcf4282bbf6ca46e02f8f88c44c42e8) switched from
CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task MapPartition
(MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) edd157c16655a651bf35885f5a23e3e9.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (4/16) (d5f76a39e2c2bd8e9ad90712d49511cf) switched from
SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task MapPartition
(MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) 9fea6ffbde197d94a3690763986c2c02.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (6/16) (bbcf4282bbf6ca46e02f8f88c44c42e8) switched from
SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink
(DiscardingOutput) (4/16) (attempt #0) to localhost
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink
(DiscardingOutput) (6/16) (attempt #0) to localhost
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition
(MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (4/16) (edd157c16655a651bf35885f5a23e3e9) switched from RUNNING to
FINISHED.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink
(DiscardingOutput) (6/16).
[DataSink (DiscardingOutput) (6/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (6/16)
(bbcf4282bbf6ca46e02f8f88c44c42e8) switched from CREATED to DEPLOYING.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition
(MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (6/16) (9fea6ffbde197d94a3690763986c2c02) switched from RUNNING to
FINISHED.
[DataSink (DiscardingOutput) (6/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task DataSink (DiscardingOutput) (6/16)
(bbcf4282bbf6ca46e02f8f88c44c42e8) [DEPLOYING]
[DataSink (DiscardingOutput) (6/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink
(DiscardingOutput) (6/16) (bbcf4282bbf6ca46e02f8f88c44c42e8) [DEPLOYING].
[DataSink (DiscardingOutput) (6/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network:
DataSink (DiscardingOutput) (6/16) (bbcf4282bbf6ca46e02f8f88c44c42e8)
[DEPLOYING].
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink
(DiscardingOutput) (4/16).
[DataSink (DiscardingOutput) (6/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (6/16)
(bbcf4282bbf6ca46e02f8f88c44c42e8) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (6/16) (bbcf4282bbf6ca46e02f8f88c44c42e8) switched from
DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (4/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (4/16)
(d5f76a39e2c2bd8e9ad90712d49511cf) switched from CREATED to DEPLOYING.
[DataSink (DiscardingOutput) (4/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task DataSink (DiscardingOutput) (4/16)
(d5f76a39e2c2bd8e9ad90712d49511cf) [DEPLOYING]
[DataSink (DiscardingOutput) (6/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (6/16)
(bbcf4282bbf6ca46e02f8f88c44c42e8) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (6/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink
(DiscardingOutput) (6/16) (bbcf4282bbf6ca46e02f8f88c44c42e8).
[DataSink (DiscardingOutput) (4/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink
(DiscardingOutput) (4/16) (d5f76a39e2c2bd8e9ad90712d49511cf) [DEPLOYING].
[DataSink (DiscardingOutput) (6/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task DataSink (DiscardingOutput) (6/16)
(bbcf4282bbf6ca46e02f8f88c44c42e8) [FINISHED]
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task DataSink
(DiscardingOutput) bbcf4282bbf6ca46e02f8f88c44c42e8.
[DataSink (DiscardingOutput) (4/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network:
DataSink (DiscardingOutput) (4/16) (d5f76a39e2c2bd8e9ad90712d49511cf)
[DEPLOYING].
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (6/16) (bbcf4282bbf6ca46e02f8f88c44c42e8) switched from
RUNNING to FINISHED.
[DataSink (DiscardingOutput) (4/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (4/16)
(d5f76a39e2c2bd8e9ad90712d49511cf) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (4/16) (d5f76a39e2c2bd8e9ad90712d49511cf) switched from
DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (4/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (4/16)
(d5f76a39e2c2bd8e9ad90712d49511cf) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (4/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink
(DiscardingOutput) (4/16) (d5f76a39e2c2bd8e9ad90712d49511cf).
[DataSink (DiscardingOutput) (4/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task DataSink (DiscardingOutput) (4/16)
(d5f76a39e2c2bd8e9ad90712d49511cf) [FINISHED]
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task DataSink
(DiscardingOutput) d5f76a39e2c2bd8e9ad90712d49511cf.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (4/16) (d5f76a39e2c2bd8e9ad90712d49511cf) switched from
RUNNING to FINISHED.
[MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (5/16)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition
(MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (5/16) (df9f442937c078d0738f3d8c0cccb1e7) switched from RUNNING to
FINISHED.
[MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (5/16)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task
resources for MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (5/16) (df9f442937c078d0738f3d8c0cccb1e7).
[jobmanager-future-thread-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (5/16) (4cea05f7c113938142fd32e4e346cdcd) switched from
CREATED to SCHEDULED.
[MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (5/16)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all
FileSystem streams are closed for task MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (5/16) (df9f442937c078d0738f3d8c0cccb1e7) [FINISHED]
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task MapPartition
(MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) df9f442937c078d0738f3d8c0cccb1e7.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (5/16) (4cea05f7c113938142fd32e4e346cdcd) switched from
SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink
(DiscardingOutput) (5/16) (attempt #0) to localhost
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition
(MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (5/16) (df9f442937c078d0738f3d8c0cccb1e7) switched from RUNNING to
FINISHED.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink
(DiscardingOutput) (5/16).
[DataSink (DiscardingOutput) (5/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (5/16)
(4cea05f7c113938142fd32e4e346cdcd) switched from CREATED to DEPLOYING.
[DataSink (DiscardingOutput) (5/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task DataSink (DiscardingOutput) (5/16)
(4cea05f7c113938142fd32e4e346cdcd) [DEPLOYING]
[DataSink (DiscardingOutput) (5/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink
(DiscardingOutput) (5/16) (4cea05f7c113938142fd32e4e346cdcd) [DEPLOYING].
[DataSink (DiscardingOutput) (5/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network:
DataSink (DiscardingOutput) (5/16) (4cea05f7c113938142fd32e4e346cdcd)
[DEPLOYING].
[DataSink (DiscardingOutput) (5/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (5/16)
(4cea05f7c113938142fd32e4e346cdcd) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (5/16) (4cea05f7c113938142fd32e4e346cdcd) switched from
DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (5/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (5/16)
(4cea05f7c113938142fd32e4e346cdcd) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (5/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink
(DiscardingOutput) (5/16) (4cea05f7c113938142fd32e4e346cdcd).
[DataSink (DiscardingOutput) (5/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task DataSink (DiscardingOutput) (5/16)
(4cea05f7c113938142fd32e4e346cdcd) [FINISHED]
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task DataSink
(DiscardingOutput) 4cea05f7c113938142fd32e4e346cdcd.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (5/16) (4cea05f7c113938142fd32e4e346cdcd) switched from
RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job
BeamApp-root-0922061727-d0b93a19 (9a58a8ea775606e388c657950091a9b8) switched
from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job
9a58a8ea775606e388c657950091a9b8 reached globally terminal state FINISHED.
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini
Cluster
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest
endpoint.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job
BeamApp-root-0922061727-d0b93a19(9a58a8ea775606e388c657950091a9b8).
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting
down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection
bd57eb7e00715cfe77142215fee369b2: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher
akka://flink/user/dispatcher2236f253-a9b2-433d-b395-2bb486cee36b.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all
currently running jobs of dispatcher
akka://flink/user/dispatcher2236f253-a9b2-433d-b395-2bb486cee36b.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect
job manager 977e8a10e127ea13d0035bcc17264f97@akka://flink/user/jobmanager_1 for
job 9a58a8ea775606e388c657950091a9b8 from the resource manager.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job
9a58a8ea775606e388c657950091a9b8 with leader id
977e8a10e127ea13d0035bcc17264f97 lost leadership.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the
SlotManager.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending
the SlotManager.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator
- Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher
akka://flink/user/dispatcher2236f253-a9b2-433d-b395-2bb486cee36b.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed
spill file directory /tmp/flink-io-3901ba5c-04f4-4bd4-9ff9-c761deb61928
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the
network environment and its components.
[ForkJoinPool.commonPool-worker-11] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache
directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-11] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader
service.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:40859
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] INFO
org.apache.beam.runners.flink.FlinkPipelineRunner - Execution finished in 28653
msecs
[flink-runner-job-invoker] INFO
org.apache.beam.runners.flink.FlinkPipelineRunner - Final accumulator values:
[flink-runner-job-invoker] INFO
org.apache.beam.runners.flink.FlinkPipelineRunner - __metricscontainers :
MetricQueryResults(Counters(ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles}:
0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten/ParMultiDo(WriteShardsIntoTempFiles)}:
0,
ref_PCollection_PCollection_9:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
ref_PCollection_PCollection_9:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
ref_PCollection_PCollection_9:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
ref_PCollection_PCollection_1:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2474>)_4}:
138,
ref_PCollection_PCollection_1:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:0}:
0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten/ParMultiDo(WriteShardsIntoTempFiles)}:
0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:0}:
0,
ref_PCollection_PCollection_9:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 184,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles}:
0,
ref_PCollection_PCollection_9:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_10:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard).output}: 3,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard)}: 0,
ref_PCollection_PCollection_1:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten/ParMultiDo(WriteShardsIntoTempFiles)}:
0, ref_PCollection_PCollection_1:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_1}: 1,
ref_PCollection_PCollection_1:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_2}: 3,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:0}:
0,
ref_PCollection_PCollection_9:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_10:0}: 0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_10:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous).output}:
3,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles.unwrittenRecords:0}:
0, ref_PCollection_PCollection_10:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections.out}:
3,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard).output:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard).output:0}: 0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_10:0}: 0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output}:
3,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Drop
key/Values/Map/ParMultiDo(Anonymous)}: 0,
ref_PCollection_PCollection_10:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles.writtenRecords}:
3,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles.unwrittenRecords:0}:
0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard).output:0}: 0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/Values/Values/Map/ParMultiDo(Anonymous)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard).output:0}: 0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous).output:0:0}: 0,
ref_PCollection_PCollection_9:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_10:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard).output:0}: 0,
ref_PCollection_PCollection_9:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_10:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Finalize/ParMultiDo(Finalize).output}:
3,
ref_PCollection_PCollection_9:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard).output:0}: 0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/Values/Values/Map/ParMultiDo(Anonymous)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Gather
bundles/ParMultiDo(GatherBundlesPerWindow)}: 0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous).output:1:0}: 0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous).output:0:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Drop
key/Values/Map/ParMultiDo(Anonymous)}: 0,
ref_PCollection_PCollection_9:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum/ParMultiDo(Anonymous)}:
0,
ref_PCollection_PCollection_1:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
ref_PCollection_PCollection_9:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_9}: 3,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles.unwrittenRecords:0}:
0,
ref_PCollection_PCollection_1:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Gather
bundles/ParMultiDo(GatherBundlesPerWindow).output}: 3,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:0}:
0,
ref_PCollection_PCollection_1:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
ref_PCollection_PCollection_1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
ref_PCollection_PCollection_9:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/Values/Values/Map/ParMultiDo(Anonymous)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Finalize/ParMultiDo(Finalize)}:
0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections}:
0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Drop
key/Values/Map/ParMultiDo(Anonymous).output}: 3,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard).output}: 3,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Gather
bundles/ParMultiDo(GatherBundlesPerWindow)}: 0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous)}: 0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous)}: 0,
ref_PCollection_PCollection_1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum/ParMultiDo(Anonymous)}:
0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Gather
bundles/ParMultiDo(GatherBundlesPerWindow)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:0}:
0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_11}: 3,
ref_PCollection_PCollection_1:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2474>)_4}:
0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:0}:
0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous)}:
0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous)}:
0, ref_PCollection_PCollection_10:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_10}: 3,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous)}:
0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous).output:1:0}: 0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous).output:0:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output}:
3,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Drop
key/Values/Map/ParMultiDo(Anonymous)}: 0,
ref_PCollection_PCollection_10:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous).output:0}: 3,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous)}: 0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous).output}:
3, ref_PCollection_PCollection_9:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_10}: 3,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous)}:
0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous)}: 0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:0}:
0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous)}:
0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous).output:1:0}: 0,
ref_PCollection_PCollection_1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2474>)_4}:
0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:0}:
0,
ref_PCollection_PCollection_1:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2474>)_4}:
138,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Finalize/ParMultiDo(Finalize)}:
0,
ref_PCollection_PCollection_1:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output}:
3,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections}:
0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous)}:
0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles}:
0,
ref_PCollection_PCollection_9:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 184,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Finalize/ParMultiDo(Finalize)}:
0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum/ParMultiDo(Anonymous)}:
0)Distributions(ref_PCollection_PCollection_9:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_9}: DistributionResult{sum=57,
count=3, min=19, max=19},
ref_PCollection_PCollection_9:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_10}: DistributionResult{sum=51,
count=3, min=17, max=17},
ref_PCollection_PCollection_1:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_1}: DistributionResult{sum=13,
count=1, min=13, max=13},
ref_PCollection_PCollection_1:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_2}: DistributionResult{sum=54,
count=3, min=18, max=18}))
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService
- Manifest at
/tmp/beam-artifact-staging/job_555c53b1-56a9-4fc8-9bb2-5d176b6e1619/MANIFEST
has 1 artifact locations
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService
- Removed dir
/tmp/beam-artifact-staging/job_555c53b1-56a9-4fc8-9bb2-5d176b6e1619/
ok
test_java_expansion_dataflow
(apache_beam.transforms.external_test.ExternalTransformTest) ... SKIP: No
expansion service jar or port provided.
test_java_expansion_portable_runner
(apache_beam.transforms.external_test.ExternalTransformTest) ... ERROR
test_multi (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_nested (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_payload (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_pipeline_generation
(apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_simple (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
======================================================================
ERROR: test_java_expansion_portable_runner
(apache_beam.transforms.external_test.ExternalTransformTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/external_test.py";,>
line 315, in test_java_expansion_portable_runner
ExternalTransformTest.run_pipeline_with_portable_runner(None)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/external_test.py";,>
line 348, in run_pipeline_with_portable_runner
pipeline_options, ExternalTransformTest.expansion_service_port, True)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/external_test.py";,>
line 375, in run_pipeline
| beam.Map(lambda kv: '%s: %s' % kv))
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/pvalue.py";,>
line 113, in __or__
return self.pipeline.apply(ptransform, self)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 517, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 175, in apply
return m(transform, input, options)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 181, in apply_PTransform
return transform.expand(input)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 320, in expand
channel).Expand(request)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 565, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 467, in _end_unary_response_blocking
raise _Rendezvous(state, None, None, deadline)
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "DNS resolution failed"
debug_error_string =
"{"created":"@1569133081.336316203","description":"Failed to pick
subchannel","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":3818,"referenced_errors":[{"created":"@1569133081.336304430","description":"Resolver
transient
failure","file":"src/core/ext/filters/client_channel/resolving_lb_policy.cc","file_line":268,"referenced_errors":[{"created":"@1569133081.336302067","description":"DNS
resolution
failed","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/dns_resolver_ares.cc","file_line":357,"grpc_status":14,"referenced_errors":[{"created":"@1569133081.336253216","description":"C-ares
status is not ARES_SUCCESS: Domain name not
found","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":244,"referenced_errors":[{"created":"@1569133081.216991223","description":"C-ares
status is not ARES_SUCCESS: Domain name not
found","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":244}]}]}]}]}"
>
----------------------------------------------------------------------
XML: nosetests-xlangValidateRunner.xml
----------------------------------------------------------------------
XML:
<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 9 tests in 82.828s
FAILED (SKIP=1, errors=1)
> Task
> :runners:flink:1.5:job-server:validatesCrossLanguageRunnerPythonUsingJava
> FAILED
> Task
> :runners:flink:1.5:job-server:validatesCrossLanguageRunnerPythonUsingPython
setup.py:185: UserWarning: You are using Apache Beam with Python 2. New
releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/setuptools/dist.py>:474:
UserWarning: Normalizing '2.17.0.dev' to '2.17.0.dev0'
normalized_version,
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/__init__.py>:84:
UserWarning: You are using Apache Beam with Python 2. New releases of Apache
Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
test_generate_sequence
(apache_beam.io.external.generate_sequence_test.XlangGenerateSequenceTest) ...
ok
test_write (apache_beam.io.external.xlang_parquetio_test.XlangParquetIOTest)
... ok
test_java_expansion_dataflow
(apache_beam.transforms.external_test.ExternalTransformTest) ... SKIP: No
expansion service jar or port provided.
test_java_expansion_portable_runner
(apache_beam.transforms.external_test.ExternalTransformTest) ... ERROR
test_multi (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_nested (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_payload (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_pipeline_generation
(apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_simple (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
======================================================================
ERROR: test_java_expansion_portable_runner
(apache_beam.transforms.external_test.ExternalTransformTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/external_test.py";,>
line 315, in test_java_expansion_portable_runner
ExternalTransformTest.run_pipeline_with_portable_runner(None)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/external_test.py";,>
line 348, in run_pipeline_with_portable_runner
pipeline_options, ExternalTransformTest.expansion_service_port, True)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/external_test.py";,>
line 375, in run_pipeline
| beam.Map(lambda kv: '%s: %s' % kv))
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/pvalue.py";,>
line 113, in __or__
return self.pipeline.apply(ptransform, self)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 517, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 175, in apply
return m(transform, input, options)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 181, in apply_PTransform
return transform.expand(input)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 320, in expand
channel).Expand(request)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 565, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 467, in _end_unary_response_blocking
raise _Rendezvous(state, None, None, deadline)
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "DNS resolution failed"
debug_error_string =
"{"created":"@1569133101.259217277","description":"Failed to pick
subchannel","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":3818,"referenced_errors":[{"created":"@1569133101.259206347","description":"Resolver
transient
failure","file":"src/core/ext/filters/client_channel/resolving_lb_policy.cc","file_line":268,"referenced_errors":[{"created":"@1569133101.259203600","description":"DNS
resolution
failed","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/dns_resolver_ares.cc","file_line":357,"grpc_status":14,"referenced_errors":[{"created":"@1569133101.259157766","description":"C-ares
status is not ARES_SUCCESS: Domain name not
found","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":244,"referenced_errors":[{"created":"@1569133101.227860899","description":"C-ares
status is not ARES_SUCCESS: Domain name not
found","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":244}]}]}]}]}"
>
----------------------------------------------------------------------
XML: nosetests-xlangValidateRunner.xml
----------------------------------------------------------------------
XML:
<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 9 tests in 14.408s
FAILED (SKIP=1, errors=1)
> Task
> :runners:flink:1.5:job-server:validatesCrossLanguageRunnerPythonUsingPython
> FAILED
> Task :runners:flink:1.5:job-server:validatesCrossLanguageRunnerCleanup
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:flink:1.5:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:flink:1.5:job-server:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 5s
125 actionable tasks: 94 executed, 25 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/6dqxnu55uuhro
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org
