See
<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/432/display/redirect?page=changes>
Changes:
[robertwb] Refactor job server subprocess logic to be used elsewhere.
[robertwb] Add java jar based expansion service.
[robertwb] Avoid comparison with param.default in type signature analysis.
[robertwb] More documentation.
------------------------------------------
[...truncated 2.37 MB...]
[DataSink (DiscardingOutput) (7/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (7/16)
(c76abb47c09c60eef76e8cbe6ccf408c) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (7/16) (c76abb47c09c60eef76e8cbe6ccf408c) switched from
DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (7/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (7/16)
(c76abb47c09c60eef76e8cbe6ccf408c) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (7/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink
(DiscardingOutput) (7/16) (c76abb47c09c60eef76e8cbe6ccf408c).
[DataSink (DiscardingOutput) (7/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task DataSink (DiscardingOutput) (7/16)
(c76abb47c09c60eef76e8cbe6ccf408c) [FINISHED]
[MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (8/16)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition
(MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (8/16) (be4ccdff049b55b1d967773afd7f6a42) switched from RUNNING to
FINISHED.
[MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (8/16)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task
resources for MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (8/16) (be4ccdff049b55b1d967773afd7f6a42).
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task DataSink
(DiscardingOutput) c76abb47c09c60eef76e8cbe6ccf408c.
[MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (8/16)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all
FileSystem streams are closed for task MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (8/16) (be4ccdff049b55b1d967773afd7f6a42) [FINISHED]
[jobmanager-future-thread-1] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (8/16) (1c5389dfe48d1306f2efd1cdd3b196e5) switched from
CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task MapPartition
(MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) be4ccdff049b55b1d967773afd7f6a42.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (7/16) (c76abb47c09c60eef76e8cbe6ccf408c) switched from
RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (8/16) (1c5389dfe48d1306f2efd1cdd3b196e5) switched from
SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink
(DiscardingOutput) (8/16) (attempt #0) to localhost
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition
(MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (8/16) (be4ccdff049b55b1d967773afd7f6a42) switched from RUNNING to
FINISHED.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink
(DiscardingOutput) (8/16).
[DataSink (DiscardingOutput) (8/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (8/16)
(1c5389dfe48d1306f2efd1cdd3b196e5) switched from CREATED to DEPLOYING.
[DataSink (DiscardingOutput) (8/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task DataSink (DiscardingOutput) (8/16)
(1c5389dfe48d1306f2efd1cdd3b196e5) [DEPLOYING]
[DataSink (DiscardingOutput) (8/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink
(DiscardingOutput) (8/16) (1c5389dfe48d1306f2efd1cdd3b196e5) [DEPLOYING].
[DataSink (DiscardingOutput) (8/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network:
DataSink (DiscardingOutput) (8/16) (1c5389dfe48d1306f2efd1cdd3b196e5)
[DEPLOYING].
[DataSink (DiscardingOutput) (8/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (8/16)
(1c5389dfe48d1306f2efd1cdd3b196e5) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (8/16) (1c5389dfe48d1306f2efd1cdd3b196e5) switched from
DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (8/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (8/16)
(1c5389dfe48d1306f2efd1cdd3b196e5) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (8/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink
(DiscardingOutput) (8/16) (1c5389dfe48d1306f2efd1cdd3b196e5).
[DataSink (DiscardingOutput) (8/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task DataSink (DiscardingOutput) (8/16)
(1c5389dfe48d1306f2efd1cdd3b196e5) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task DataSink
(DiscardingOutput) 1c5389dfe48d1306f2efd1cdd3b196e5.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (8/16) (1c5389dfe48d1306f2efd1cdd3b196e5) switched from
RUNNING to FINISHED.
[MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (12/16)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition
(MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (12/16) (48651b2152421516aa569c16f6dc96c1) switched from RUNNING to
FINISHED.
[MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (12/16)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task
resources for MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (12/16) (48651b2152421516aa569c16f6dc96c1).
[MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (12/16)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all
FileSystem streams are closed for task MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (12/16) (48651b2152421516aa569c16f6dc96c1) [FINISHED]
[jobmanager-future-thread-7] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (12/16) (eac5760abaa3137db405b2b13b9f06c1) switched from
CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task MapPartition
(MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) 48651b2152421516aa569c16f6dc96c1.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (12/16) (eac5760abaa3137db405b2b13b9f06c1) switched from
SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink
(DiscardingOutput) (12/16) (attempt #0) to localhost
[MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (9/16)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition
(MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (9/16) (a558960345f7e16f106f28312b5a8590) switched from RUNNING to
FINISHED.
[MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (9/16)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task
resources for MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (9/16) (a558960345f7e16f106f28312b5a8590).
[MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (9/16)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all
FileSystem streams are closed for task MapPartition (MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (9/16) (a558960345f7e16f106f28312b5a8590) [FINISHED]
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition
(MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (12/16) (48651b2152421516aa569c16f6dc96c1) switched from RUNNING to
FINISHED.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink
(DiscardingOutput) (12/16).
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task MapPartition
(MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) a558960345f7e16f106f28312b5a8590.
[jobmanager-future-thread-11] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (9/16) (e58b708371ce7971a1f27eeb5ef35436) switched from
CREATED to SCHEDULED.
[DataSink (DiscardingOutput) (12/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (12/16)
(eac5760abaa3137db405b2b13b9f06c1) switched from CREATED to DEPLOYING.
[DataSink (DiscardingOutput) (12/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task DataSink (DiscardingOutput) (12/16)
(eac5760abaa3137db405b2b13b9f06c1) [DEPLOYING]
[DataSink (DiscardingOutput) (12/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink
(DiscardingOutput) (12/16) (eac5760abaa3137db405b2b13b9f06c1) [DEPLOYING].
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (9/16) (e58b708371ce7971a1f27eeb5ef35436) switched from
SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink
(DiscardingOutput) (9/16) (attempt #0) to localhost
[DataSink (DiscardingOutput) (12/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network:
DataSink (DiscardingOutput) (12/16) (eac5760abaa3137db405b2b13b9f06c1)
[DEPLOYING].
[DataSink (DiscardingOutput) (12/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (12/16)
(eac5760abaa3137db405b2b13b9f06c1) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition
(MapPartition at
[2]ExternalTransform(beam:transforms:xlang:parquet_write)/{FileIO.Write,
Values}) (9/16) (a558960345f7e16f106f28312b5a8590) switched from RUNNING to
FINISHED.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (12/16) (eac5760abaa3137db405b2b13b9f06c1) switched from
DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink
(DiscardingOutput) (9/16).
[DataSink (DiscardingOutput) (12/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (12/16)
(eac5760abaa3137db405b2b13b9f06c1) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (12/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink
(DiscardingOutput) (12/16) (eac5760abaa3137db405b2b13b9f06c1).
[DataSink (DiscardingOutput) (12/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task DataSink (DiscardingOutput) (12/16)
(eac5760abaa3137db405b2b13b9f06c1) [FINISHED]
[DataSink (DiscardingOutput) (9/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (9/16)
(e58b708371ce7971a1f27eeb5ef35436) switched from CREATED to DEPLOYING.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task DataSink
(DiscardingOutput) eac5760abaa3137db405b2b13b9f06c1.
[DataSink (DiscardingOutput) (9/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task DataSink (DiscardingOutput) (9/16)
(e58b708371ce7971a1f27eeb5ef35436) [DEPLOYING]
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (12/16) (eac5760abaa3137db405b2b13b9f06c1) switched from
RUNNING to FINISHED.
[DataSink (DiscardingOutput) (9/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink
(DiscardingOutput) (9/16) (e58b708371ce7971a1f27eeb5ef35436) [DEPLOYING].
[DataSink (DiscardingOutput) (9/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network:
DataSink (DiscardingOutput) (9/16) (e58b708371ce7971a1f27eeb5ef35436)
[DEPLOYING].
[DataSink (DiscardingOutput) (9/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (9/16)
(e58b708371ce7971a1f27eeb5ef35436) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (9/16) (e58b708371ce7971a1f27eeb5ef35436) switched from
DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (9/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (9/16)
(e58b708371ce7971a1f27eeb5ef35436) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (9/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink
(DiscardingOutput) (9/16) (e58b708371ce7971a1f27eeb5ef35436).
[DataSink (DiscardingOutput) (9/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task DataSink (DiscardingOutput) (9/16)
(e58b708371ce7971a1f27eeb5ef35436) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task DataSink
(DiscardingOutput) e58b708371ce7971a1f27eeb5ef35436.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (9/16) (e58b708371ce7971a1f27eeb5ef35436) switched from
RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job
BeamApp-root-0920230354-60265b39 (0b1f48b21b8f97f7bf307c14d0a544be) switched
from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job
0b1f48b21b8f97f7bf307c14d0a544be reached globally terminal state FINISHED.
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini
Cluster
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest
endpoint.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job
BeamApp-root-0920230354-60265b39(0b1f48b21b8f97f7bf307c14d0a544be).
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting
down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection
b05bc15694ecebe1f694488764464ad0: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher
akka://flink/user/dispatcher1026a686-e535-4da4-a2b1-cafdb715c49f.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all
currently running jobs of dispatcher
akka://flink/user/dispatcher1026a686-e535-4da4-a2b1-cafdb715c49f.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job
0b1f48b21b8f97f7bf307c14d0a544be with leader id
9ef7097ed514a5a5224f7c2bd6714ae3 lost leadership.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect
job manager 9ef7097ed514a5a5224f7c2bd6714ae3@akka://flink/user/jobmanager_1 for
job 0b1f48b21b8f97f7bf307c14d0a544be from the resource manager.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed
spill file directory /tmp/flink-io-fd21c90d-32e3-4644-88f2-0510899002c2
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the
network environment and its components.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator
- Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher
akka://flink/user/dispatcher1026a686-e535-4da4-a2b1-cafdb715c49f.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the
SlotManager.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending
the SlotManager.
[ForkJoinPool.commonPool-worker-9] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache
directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-9] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader
service.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:37661
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] INFO
org.apache.beam.runners.flink.FlinkPipelineRunner - Execution finished in 25684
msecs
[flink-runner-job-invoker] INFO
org.apache.beam.runners.flink.FlinkPipelineRunner - Final accumulator values:
[flink-runner-job-invoker] INFO
org.apache.beam.runners.flink.FlinkPipelineRunner - __metricscontainers :
MetricQueryResults(Counters(ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles}:
0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten/ParMultiDo(WriteShardsIntoTempFiles)}:
0,
ref_PCollection_PCollection_9:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
ref_PCollection_PCollection_9:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
ref_PCollection_PCollection_9:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
ref_PCollection_PCollection_1:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2474>)_4}:
67,
ref_PCollection_PCollection_1:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:0}:
0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten/ParMultiDo(WriteShardsIntoTempFiles)}:
0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:0}:
0,
ref_PCollection_PCollection_9:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 114,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles}:
0,
ref_PCollection_PCollection_9:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_10:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard).output}: 3,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard)}: 0,
ref_PCollection_PCollection_1:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten/ParMultiDo(WriteShardsIntoTempFiles)}:
0, ref_PCollection_PCollection_1:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_1}: 1,
ref_PCollection_PCollection_1:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_2}: 3,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:0}:
0,
ref_PCollection_PCollection_9:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_10:0}: 0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_10:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous).output}:
3,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles.unwrittenRecords:0}:
0, ref_PCollection_PCollection_10:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections.out}:
3,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard).output:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard).output:0}: 0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_10:0}: 0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output}:
3,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Drop
key/Values/Map/ParMultiDo(Anonymous)}: 0,
ref_PCollection_PCollection_10:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles.writtenRecords}:
3,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles.unwrittenRecords:0}:
0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard).output:0}: 0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/Values/Values/Map/ParMultiDo(Anonymous)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard).output:0}: 0,
ref_PCollection_PCollection_9:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_10:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard).output:0}: 0,
ref_PCollection_PCollection_9:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_10:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Finalize/ParMultiDo(Finalize).output}:
3,
ref_PCollection_PCollection_9:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard).output:0}: 0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/Values/Values/Map/ParMultiDo(Anonymous)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Gather
bundles/ParMultiDo(GatherBundlesPerWindow)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Drop
key/Values/Map/ParMultiDo(Anonymous)}: 0,
ref_PCollection_PCollection_9:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum/ParMultiDo(Anonymous)}:
0,
ref_PCollection_PCollection_1:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous).output:1:0}: 0,
ref_PCollection_PCollection_9:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_9}: 3,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous).output:0:0}: 0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles.unwrittenRecords:0}:
0,
ref_PCollection_PCollection_1:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Gather
bundles/ParMultiDo(GatherBundlesPerWindow).output}: 3,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:0}:
0,
ref_PCollection_PCollection_1:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
ref_PCollection_PCollection_1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
ref_PCollection_PCollection_9:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/Values/Values/Map/ParMultiDo(Anonymous)}: 0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous).output:0:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Finalize/ParMultiDo(Finalize)}:
0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections}:
0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Drop
key/Values/Map/ParMultiDo(Anonymous).output}: 3,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair
with random key/ParMultiDo(AssignShard).output}: 3,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous).output:1:0}: 0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Gather
bundles/ParMultiDo(GatherBundlesPerWindow)}: 0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous)}: 0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous)}: 0,
ref_PCollection_PCollection_1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous).output:1:0}: 0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum/ParMultiDo(Anonymous)}:
0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Gather
bundles/ParMultiDo(GatherBundlesPerWindow)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:0}:
0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_11}: 3,
ref_PCollection_PCollection_1:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2474>)_4}:
0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:0}:
0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous)}:
0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous)}:
0, ref_PCollection_PCollection_10:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_10}: 3,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous).output:0:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous)}:
0, ref_PCollection_PCollection_10:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous).output:1}: 3,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output}:
3,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Drop
key/Values/Map/ParMultiDo(Anonymous)}: 0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous)}: 0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous).output}:
3, ref_PCollection_PCollection_9:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_10}: 3,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous)}:
0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous)}: 0,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:0}:
0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous)}:
0,
ref_PCollection_PCollection_1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2474>)_4}:
2,
external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:0}:
0,
ref_PCollection_PCollection_1:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2474>)_4}:
65,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Add
void key/AddKeys/Map/ParMultiDo(Anonymous)}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Finalize/ParMultiDo(Finalize)}:
0,
ref_PCollection_PCollection_1:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:element_count:v1
{PCOLLECTION=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output}:
3,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections}:
0,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous)}:
0,
ref_PCollection_PCollection_10:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles}:
0,
ref_PCollection_PCollection_9:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 114,
external_2root/FileIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/FinalizeTempFileBundles/Finalize/ParMultiDo(Finalize)}:
0,
external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten.out:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_2root/FileIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum/ParMultiDo(Anonymous)}:
0)Distributions(ref_PCollection_PCollection_9:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_9}: DistributionResult{sum=57,
count=3, min=19, max=19},
ref_PCollection_PCollection_9:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_10}: DistributionResult{sum=51,
count=3, min=17, max=17},
ref_PCollection_PCollection_1:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_1}: DistributionResult{sum=13,
count=1, min=13, max=13},
ref_PCollection_PCollection_1:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_2}: DistributionResult{sum=54,
count=3, min=18, max=18}))
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService
- Manifest at
/tmp/beam-artifact-staging/job_b84d94fc-d0ef-43be-9d23-d4f92b0a8f3a/MANIFEST
has 1 artifact locations
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService
- Removed dir
/tmp/beam-artifact-staging/job_b84d94fc-d0ef-43be-9d23-d4f92b0a8f3a/
ok
test_java_expansion_dataflow
(apache_beam.transforms.external_test.ExternalTransformTest) ... SKIP: No
expansion service jar or port provided.
test_java_expansion_portable_runner
(apache_beam.transforms.external_test.ExternalTransformTest) ... ERROR
test_multi (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_nested (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_payload (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_pipeline_generation
(apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_simple (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
======================================================================
ERROR: test_java_expansion_portable_runner
(apache_beam.transforms.external_test.ExternalTransformTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/external_test.py";,>
line 315, in test_java_expansion_portable_runner
ExternalTransformTest.run_pipeline_with_portable_runner(None)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/external_test.py";,>
line 348, in run_pipeline_with_portable_runner
pipeline_options, ExternalTransformTest.expansion_service_port, True)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/external_test.py";,>
line 375, in run_pipeline
| beam.Map(lambda kv: '%s: %s' % kv))
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/pvalue.py";,>
line 113, in __or__
return self.pipeline.apply(ptransform, self)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 517, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 175, in apply
return m(transform, input, options)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 181, in apply_PTransform
return transform.expand(input)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 320, in expand
channel).Expand(request)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 565, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 467, in _end_unary_response_blocking
raise _Rendezvous(state, None, None, deadline)
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "DNS resolution failed"
debug_error_string =
"{"created":"@1569020664.127126692","description":"Failed to pick
subchannel","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":3818,"referenced_errors":[{"created":"@1569020664.127115110","description":"Resolver
transient
failure","file":"src/core/ext/filters/client_channel/resolving_lb_policy.cc","file_line":268,"referenced_errors":[{"created":"@1569020664.127112178","description":"DNS
resolution
failed","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/dns_resolver_ares.cc","file_line":357,"grpc_status":14,"referenced_errors":[{"created":"@1569020664.127066670","description":"C-ares
status is not ARES_SUCCESS: Domain name not
found","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":244,"referenced_errors":[{"created":"@1569020664.114798479","description":"C-ares
status is not ARES_SUCCESS: Domain name not
found","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":244}]}]}]}]}"
>
----------------------------------------------------------------------
XML: nosetests-xlangValidateRunner.xml
----------------------------------------------------------------------
XML:
<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 9 tests in 67.574s
FAILED (SKIP=1, errors=1)
> Task
> :runners:flink:1.5:job-server:validatesCrossLanguageRunnerPythonUsingJava
> FAILED
> Task
> :runners:flink:1.5:job-server:validatesCrossLanguageRunnerPythonUsingPython
setup.py:185: UserWarning: You are using Apache Beam with Python 2. New
releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/setuptools/dist.py>:474:
UserWarning: Normalizing '2.17.0.dev' to '2.17.0.dev0'
normalized_version,
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/__init__.py>:84:
UserWarning: You are using Apache Beam with Python 2. New releases of Apache
Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
test_generate_sequence
(apache_beam.io.external.generate_sequence_test.XlangGenerateSequenceTest) ...
ok
test_write (apache_beam.io.external.xlang_parquetio_test.XlangParquetIOTest)
... ok
test_java_expansion_dataflow
(apache_beam.transforms.external_test.ExternalTransformTest) ... SKIP: No
expansion service jar or port provided.
test_java_expansion_portable_runner
(apache_beam.transforms.external_test.ExternalTransformTest) ... ERROR
test_multi (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_nested (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_payload (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_pipeline_generation
(apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_simple (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
======================================================================
ERROR: test_java_expansion_portable_runner
(apache_beam.transforms.external_test.ExternalTransformTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/external_test.py";,>
line 315, in test_java_expansion_portable_runner
ExternalTransformTest.run_pipeline_with_portable_runner(None)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/external_test.py";,>
line 348, in run_pipeline_with_portable_runner
pipeline_options, ExternalTransformTest.expansion_service_port, True)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/external_test.py";,>
line 375, in run_pipeline
| beam.Map(lambda kv: '%s: %s' % kv))
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/pvalue.py";,>
line 113, in __or__
return self.pipeline.apply(ptransform, self)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 517, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 175, in apply
return m(transform, input, options)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 181, in apply_PTransform
return transform.expand(input)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 320, in expand
channel).Expand(request)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 565, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 467, in _end_unary_response_blocking
raise _Rendezvous(state, None, None, deadline)
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "DNS resolution failed"
debug_error_string =
"{"created":"@1569020675.208905109","description":"Failed to pick
subchannel","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":3818,"referenced_errors":[{"created":"@1569020675.208894118","description":"Resolver
transient
failure","file":"src/core/ext/filters/client_channel/resolving_lb_policy.cc","file_line":268,"referenced_errors":[{"created":"@1569020675.208892123","description":"DNS
resolution
failed","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/dns_resolver_ares.cc","file_line":357,"grpc_status":14,"referenced_errors":[{"created":"@1569020675.208844336","description":"C-ares
status is not ARES_SUCCESS: Domain name not
found","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":244,"referenced_errors":[{"created":"@1569020675.201365704","description":"C-ares
status is not ARES_SUCCESS: Domain name not
found","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":244}]}]}]}]}"
>
----------------------------------------------------------------------
XML: nosetests-xlangValidateRunner.xml
----------------------------------------------------------------------
XML:
<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 9 tests in 6.307s
FAILED (SKIP=1, errors=1)
> Task
> :runners:flink:1.5:job-server:validatesCrossLanguageRunnerPythonUsingPython
> FAILED
> Task :runners:flink:1.5:job-server:validatesCrossLanguageRunnerCleanup
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:flink:1.5:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:flink:1.5:job-server:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 29s
125 actionable tasks: 94 executed, 25 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/bx4s5x5djcmq6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org
