See
<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/1987/display/redirect?page=changes>
Changes:
[github] [BEAM-9746] check for 0 length copies from state (#11413)
[daniel.o.programmer] [BEAM-9642] Fix infinite recursion.
------------------------------------------
[...truncated 1.50 MB...]
INFO:apache_beam.utils.subprocess_server:b'[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input1
-> Map (1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input1
-> Map (1/2) (4e7efb80ad854751e1e24048280d7539) switched from RUNNING to
FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input1
-> Map (1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task
resources for
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input1
-> Map (1/2) (4e7efb80ad854751e1e24048280d7539).\n'
INFO:apache_beam.utils.subprocess_server:b'[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input1
-> Map (1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all
FileSystem streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input1
-> Map (1/2) (4e7efb80ad854751e1e24048280d7539) [FINISHED]\n'
INFO:apache_beam.utils.subprocess_server:b'[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_32-python_side_input1
-> Map (2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_32-python_side_input1
-> Map (2/2) (381e796f4532000dea3ac9d3f77a5100) switched from RUNNING to
FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_32-python_side_input1
-> Map (2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task
resources for
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_32-python_side_input1
-> Map (2/2) (381e796f4532000dea3ac9d3f77a5100).\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-4]
INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task
and sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_32-python_side_input1
-> Map (1/2) cfb8efdbb286f3bc815b0aeee04e358e.\n'
INFO:apache_beam.utils.subprocess_server:b'[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input1
-> Map (2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input1
-> Map (2/2) (04e856f36b20a5c6e847857e4eff64f6) switched from RUNNING to
FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input1
-> Map (2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task
resources for
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input1
-> Map (2/2) (04e856f36b20a5c6e847857e4eff64f6).\n'
INFO:apache_beam.utils.subprocess_server:b'[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_32-python_side_input1
-> Map (2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all
FileSystem streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_32-python_side_input1
-> Map (2/2) (381e796f4532000dea3ac9d3f77a5100) [FINISHED]\n'
INFO:apache_beam.utils.subprocess_server:b'[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input1
-> Map (2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all
FileSystem streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input1
-> Map (2/2) (04e856f36b20a5c6e847857e4eff64f6) [FINISHED]\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-4]
INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task
and sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input1
-> Map (1/2) 4e7efb80ad854751e1e24048280d7539.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-4]
INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task
and sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_32-python_side_input1
-> Map (2/2) 381e796f4532000dea3ac9d3f77a5100.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-4]
INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task
and sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input1
-> Map (2/2) 04e856f36b20a5c6e847857e4eff64f6.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-6]
INFO org.apache.flink.runtime.executiongraph.ExecutionGraph -
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(558834a27f2a0024614b6b89d8196649) switched from RUNNING to FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-6]
INFO org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_32-python_side_input1
-> Map (1/2) (cfb8efdbb286f3bc815b0aeee04e358e) switched from RUNNING to
FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-6]
INFO org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input1
-> Map (1/2) (4e7efb80ad854751e1e24048280d7539) switched from RUNNING to
FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-6]
INFO org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_32-python_side_input1
-> Map (2/2) (381e796f4532000dea3ac9d3f77a5100) switched from RUNNING to
FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-6]
INFO org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input1
-> Map (2/2) (04e856f36b20a5c6e847857e4eff64f6) switched from RUNNING to
FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[[1]write/Write/WriteImpl/PreFinalize
-> Map -> ToKeyedWorkItem (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)
(feece8523d62f44882aad5736ec6f570) switched from RUNNING to FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[[1]write/Write/WriteImpl/PreFinalize
-> Map -> ToKeyedWorkItem (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)
(feece8523d62f44882aad5736ec6f570).\n'
INFO:apache_beam.utils.subprocess_server:b'[[1]write/Write/WriteImpl/PreFinalize
-> Map -> ToKeyedWorkItem (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem
(2/2) (feece8523d62f44882aad5736ec6f570) [FINISHED]\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-4]
INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task
and sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)
feece8523d62f44882aad5736ec6f570.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-4]
INFO org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)
(feece8523d62f44882aad5736ec6f570) switched from RUNNING to FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[[1]write/Write/WriteImpl/PreFinalize
-> Map -> ToKeyedWorkItem (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)
(825f06f31399f652a2bbe31f5d561389) switched from RUNNING to FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[[1]write/Write/WriteImpl/PreFinalize
-> Map -> ToKeyedWorkItem (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)
(825f06f31399f652a2bbe31f5d561389).\n'
INFO:apache_beam.utils.subprocess_server:b'[[1]write/Write/WriteImpl/PreFinalize
-> Map -> ToKeyedWorkItem (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem
(1/2) (825f06f31399f652a2bbe31f5d561389) [FINISHED]\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-7]
INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task
and sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)
825f06f31399f652a2bbe31f5d561389.\n'
INFO:apache_beam.utils.subprocess_server:b'[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input2
-> Map (2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input2
-> Map (2/2) (e992dbb72aaea6d3dc39dd579de70687) switched from RUNNING to
FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input2
-> Map (2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task
resources for
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input2
-> Map (2/2) (e992dbb72aaea6d3dc39dd579de70687).\n'
INFO:apache_beam.utils.subprocess_server:b'[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input2
-> Map (2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all
FileSystem streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input2
-> Map (2/2) (e992dbb72aaea6d3dc39dd579de70687) [FINISHED]\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-7]
INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task
and sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input2
-> Map (2/2) e992dbb72aaea6d3dc39dd579de70687.\n'
INFO:apache_beam.utils.subprocess_server:b'[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input2
-> Map (1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input2
-> Map (1/2) (a2dc4709d3ed2d40130692f75a288e7f) switched from RUNNING to
FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input2
-> Map (1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task
resources for
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input2
-> Map (1/2) (a2dc4709d3ed2d40130692f75a288e7f).\n'
INFO:apache_beam.utils.subprocess_server:b'[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input2
-> Map (1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all
FileSystem streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input2
-> Map (1/2) (a2dc4709d3ed2d40130692f75a288e7f) [FINISHED]\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-4]
INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task
and sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input2
-> Map (1/2) a2dc4709d3ed2d40130692f75a288e7f.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-7]
INFO org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)
(825f06f31399f652a2bbe31f5d561389) switched from RUNNING to FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-7]
INFO org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input2
-> Map (2/2) (e992dbb72aaea6d3dc39dd579de70687) switched from RUNNING to
FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-7]
INFO org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33-python_side_input2
-> Map (1/2) (a2dc4709d3ed2d40130692f75a288e7f) switched from RUNNING to
FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[grpc-default-executor-0] INFO
/usr/local/lib/python3.5/site-packages/apache_beam/io/filebasedsink.py:310 -
Starting finalize_write threads with num_shards: 2 (skipped: 0), batches: 2,
num_threads: 2\n'
INFO:apache_beam.utils.subprocess_server:b'[[1]write/Write/WriteImpl/FinalizeWrite
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/FinalizeWrite (2/2) (72dcc10dbb0d7b9d0d8440c2ed901ab5)
switched from RUNNING to FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[[1]write/Write/WriteImpl/FinalizeWrite
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for [1]write/Write/WriteImpl/FinalizeWrite (2/2)
(72dcc10dbb0d7b9d0d8440c2ed901ab5).\n'
INFO:apache_beam.utils.subprocess_server:b'[[1]write/Write/WriteImpl/FinalizeWrite
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all
FileSystem streams are closed for task [1]write/Write/WriteImpl/FinalizeWrite
(2/2) (72dcc10dbb0d7b9d0d8440c2ed901ab5) [FINISHED]\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-6]
INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task
and sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/FinalizeWrite (2/2)
72dcc10dbb0d7b9d0d8440c2ed901ab5.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-4]
INFO org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/FinalizeWrite (2/2) (72dcc10dbb0d7b9d0d8440c2ed901ab5)
switched from RUNNING to FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[grpc-default-executor-1] INFO
/usr/local/lib/python3.5/site-packages/apache_beam/io/filebasedsink.py:355 -
Renamed 2 shards in 0.11 seconds.\n'
INFO:apache_beam.utils.subprocess_server:b'[[1]write/Write/WriteImpl/FinalizeWrite
(1/2)] INFO
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Closing
environment urn: "beam:env:docker:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'payload:
"\\n$apache/beam_python3.5_sdk:2.22.0.dev"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities: "beam:coder:kv:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:length_prefix:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:bytes:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:state_backed_iterable:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities: "beam:coder:bool:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:string_utf8:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:windowed_value:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:param_windowed_value:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:timer:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities: "beam:coder:row:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:double:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:global_window:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:iterable:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:varint:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:interval_window:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:protocol:progress_reporting:v0"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:protocol:worker_status:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:version:sdk_base:apache/beam_python3.5_sdk:2.22.0.dev"\n'
INFO:apache_beam.utils.subprocess_server:b'dependencies {\n'
INFO:apache_beam.utils.subprocess_server:b' type_urn:
"beam:artifact:type:file:v1"\n'
INFO:apache_beam.utils.subprocess_server:b' type_payload:
"\\n%/tmp/tmpjgqvd537/pickled_main_session"\n'
INFO:apache_beam.utils.subprocess_server:b' role_urn:
"beam:artifact:role:staging_to:v1"\n'
INFO:apache_beam.utils.subprocess_server:b' role_payload:
"\\n\\024pickled_main_session"\n'
INFO:apache_beam.utils.subprocess_server:b'}\n'
INFO:apache_beam.utils.subprocess_server:b'\n'
INFO:apache_beam.utils.subprocess_server:b'[[1]write/Write/WriteImpl/FinalizeWrite
(1/2)] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - 1
Beam Fn Logging clients still connected during shutdown.\n'
INFO:apache_beam.utils.subprocess_server:b'[[1]write/Write/WriteImpl/FinalizeWrite
(1/2)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up
for unknown endpoint.\n'
INFO:apache_beam.utils.subprocess_server:b'[[1]write/Write/WriteImpl/FinalizeWrite
(1/2)] INFO
org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment -
Closing Docker container
65332d873bbfe009b021fddc5b1ccf9f463733b7e7cde192fca960ce6bc1eabe. Logs:\n'
INFO:apache_beam.utils.subprocess_server:b'2020/04/15 06:21:25 Provision
info:\n'
INFO:apache_beam.utils.subprocess_server:b'pipeline_options:<fields:<key:"beam:option:allow_non_restored_state:v1"
value:<bool_value:false > > fields:<key:"beam:option:app_name:v1"
value:<null_value:NULL_VALUE > > fields:<key:"beam:option:artifact_port:v1"
value:<string_value:"0" > >
fields:<key:"beam:option:auto_balance_write_files_sharding_enabled:v1"
value:<bool_value:false > > fields:<key:"beam:option:dataflow_endpoint:v1"
value:<string_value:"https://dataflow.googleapis.com" > >
fields:<key:"beam:option:direct_num_workers:v1" value:<string_value:"1" > >
fields:<key:"beam:option:direct_runner_bundle_repeat:v1"
value:<string_value:"0" > >
fields:<key:"beam:option:direct_runner_use_stacked_bundle:v1"
value:<bool_value:true > > fields:<key:"beam:option:direct_running_mode:v1"
value:<string_value:"in_memory" > >
fields:<key:"beam:option:disable_metrics:v1" value:<bool_value:false > >
fields:<key:"beam:option:dry_run:v1" value:<bool_value:false > >
fields:<key:"beam:option:enable_streaming_engine:v1" value:<bool_value:false >
> fields:<key:"beam:option:environment_cache_millis:v1" value:<string_value:"0"
> > fields:<key:"beam:option:expansion_port:v1" value:<string_value:"0" > >
fields:<key:"beam:option:experiments:v1"
value:<list_value:<values:<string_value:"beam_fn_api" > > > >
fields:<key:"beam:option:externalized_checkpoints_enabled:v1"
value:<bool_value:false > >
fields:<key:"beam:option:fail_on_checkpointing_errors:v1"
value:<bool_value:true > > fields:<key:"beam:option:flink_job_server_jar:v1"
value:<string_value:"<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.10/job-server/build/libs/beam-runners-flink-1.10-job-server-2.22.0-SNAPSHOT.jar">
> > fields:<key:"beam:option:flink_master:v1" value:<string_value:"[auto]" > >
fields:<key:"beam:option:flink_submit_uber_jar:v1" value:<bool_value:false > >
fields:<key:"beam:option:flink_version:v1" value:<string_value:"1.10" > >
fields:<key:"beam:option:gcs_performance_metrics:v1" value:<bool_value:false >
> fields:<key:"beam:option:hdfs_full_urls:v1" value:<bool_value:false > >
fields:<key:"beam:option:job_name:v1"
value:<string_value:"BeamApp-root-0415062115-356f472b" > >
fields:<key:"beam:option:job_port:v1" value:<string_value:"0" > >
fields:<key:"beam:option:job_server_timeout:v1" value:<string_value:"60" > >
fields:<key:"beam:option:load_balance_bundles:v1" value:<bool_value:false > >
fields:<key:"beam:option:no_auth:v1" value:<bool_value:false > >
fields:<key:"beam:option:object_reuse:v1" value:<bool_value:false > >
fields:<key:"beam:option:options_id:v1" value:<number_value:1 > >
fields:<key:"beam:option:output_executable_path:v1"
value:<null_value:NULL_VALUE > > fields:<key:"beam:option:parallelism:v1"
value:<string_value:"2" > > fields:<key:"beam:option:pipeline_type_check:v1"
value:<bool_value:true > > fields:<key:"beam:option:profile_cpu:v1"
value:<bool_value:false > > fields:<key:"beam:option:profile_memory:v1"
value:<bool_value:false > > fields:<key:"beam:option:profile_sample_rate:v1"
value:<number_value:1 > > fields:<key:"beam:option:retain_docker_containers:v1"
value:<bool_value:false > >
fields:<key:"beam:option:retain_externalized_checkpoints_on_cancellation:v1"
value:<bool_value:false > > fields:<key:"beam:option:runner:v1"
value:<null_value:NULL_VALUE > >
fields:<key:"beam:option:runtime_type_check:v1" value:<bool_value:false > >
fields:<key:"beam:option:save_main_session:v1" value:<bool_value:true > >
fields:<key:"beam:option:sdk_location:v1" value:<string_value:"container" > >
fields:<key:"beam:option:sdk_worker_parallelism:v1" value:<string_value:"1" > >
fields:<key:"beam:option:shutdown_sources_on_final_watermark:v1"
value:<bool_value:true > > fields:<key:"beam:option:spark_job_server_jar:v1"
value:<string_value:"<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/spark/job-server/build/libs/beam-runners-spark-job-server-2.22.0-SNAPSHOT.jar">
> > fields:<key:"beam:option:spark_master_url:v1"
value:<string_value:"local[4]" > >
fields:<key:"beam:option:spark_submit_uber_jar:v1" value:<bool_value:false > >
fields:<key:"beam:option:streaming:v1" value:<bool_value:true > >
fields:<key:"beam:option:type_check_strictness:v1"
value:<string_value:"DEFAULT_TO_ANY" > > fields:<key:"beam:option:update:v1"
value:<bool_value:false > > >
retrieval_token:"/tmp/beam-artifact-staging/job_cdc44f6f-8804-4c79-8d1b-d2dedb5e59b2/MANIFEST"
logging_endpoint:<url:"localhost:37905" >
artifact_endpoint:<url:"localhost:35879" >
control_endpoint:<url:"localhost:35215" > \n'
INFO:apache_beam.utils.subprocess_server:b'2020/04/15 06:21:25 Initializing
python harness: /opt/apache/beam/boot --id=1-1
--provision_endpoint=localhost:37791\n'
INFO:apache_beam.utils.subprocess_server:b'2020/04/15 06:21:25 Installing setup
packages ...\n'
INFO:apache_beam.utils.subprocess_server:b'2020/04/15 06:21:25 Found artifact:
pickled_main_session\n'
INFO:apache_beam.utils.subprocess_server:b'2020/04/15 06:21:25 Executing:
python -m apache_beam.runners.worker.sdk_worker_main\n'
INFO:apache_beam.utils.subprocess_server:b'Exception in thread
read_grpc_client_inputs:\n'
INFO:apache_beam.utils.subprocess_server:b'Traceback (most recent call last):\n'
INFO:apache_beam.utils.subprocess_server:b' File
"/usr/local/lib/python3.5/threading.py", line 914, in _bootstrap_inner\n'
INFO:apache_beam.utils.subprocess_server:b' self.run()\n'
INFO:apache_beam.utils.subprocess_server:b' File
"/usr/local/lib/python3.5/threading.py", line 862, in run\n'
INFO:apache_beam.utils.subprocess_server:b' self._target(*self._args,
**self._kwargs)\n'
INFO:apache_beam.utils.subprocess_server:b' File
"/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/data_plane.py",
line 545, in <lambda>\n'
INFO:apache_beam.utils.subprocess_server:b' target=lambda:
self._read_inputs(elements_iterator),\n'
INFO:apache_beam.utils.subprocess_server:b' File
"/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/data_plane.py",
line 528, in _read_inputs\n'
INFO:apache_beam.utils.subprocess_server:b' for elements in
elements_iterator:\n'
INFO:apache_beam.utils.subprocess_server:b' File
"/usr/local/lib/python3.5/site-packages/grpc/_channel.py", line 388, in
__next__\n'
INFO:apache_beam.utils.subprocess_server:b' return self._next()\n'
INFO:apache_beam.utils.subprocess_server:b' File
"/usr/local/lib/python3.5/site-packages/grpc/_channel.py", line 365, in _next\n'
INFO:apache_beam.utils.subprocess_server:b' raise self\n'
INFO:apache_beam.utils.subprocess_server:b'grpc._channel._Rendezvous:
<_Rendezvous of RPC that terminated with:\n'
INFO:apache_beam.utils.subprocess_server:b'\tstatus = StatusCode.UNAVAILABLE\n'
INFO:apache_beam.utils.subprocess_server:b'\tdetails = "DNS resolution
failed"\n'
INFO:apache_beam.utils.subprocess_server:b'\tdebug_error_string =
"{"created":"@1586931687.175422817","description":"Failed to pick
subchannel","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":3876,"referenced_errors":[{"created":"@1586931687.175418611","description":"Resolver
transient
failure","file":"src/core/ext/filters/client_channel/resolving_lb_policy.cc","file_line":263,"referenced_errors":[{"created":"@1586931687.175417101","description":"DNS
resolution
failed","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/dns_resolver_ares.cc","file_line":357,"grpc_status":14,"referenced_errors":[{"created":"@1586931687.175410017","description":"C-ares
status is not ARES_SUCCESS: Misformatted domain
name","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":244,"referenced_errors":[{"created":"@1586931687.175393049","description":"C-ares
status is not ARES_SUCCESS: Misformatted domain
name","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":244}]}]}]}]}"\n'
INFO:apache_beam.utils.subprocess_server:b'>\n'
INFO:apache_beam.utils.subprocess_server:b'\n'
INFO:apache_beam.utils.subprocess_server:b'2020/04/15 06:21:28 Python exited:
<nil>\n'
INFO:apache_beam.utils.subprocess_server:b'[[1]write/Write/WriteImpl/FinalizeWrite
(1/2)] WARN
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Error
cleaning up servers urn: "beam:env:docker:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'payload:
"\\n$apache/beam_python3.5_sdk:2.22.0.dev"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities: "beam:coder:kv:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:length_prefix:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:bytes:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:state_backed_iterable:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities: "beam:coder:bool:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:string_utf8:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:windowed_value:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:param_windowed_value:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:timer:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities: "beam:coder:row:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:double:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:global_window:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:iterable:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:varint:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:coder:interval_window:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:protocol:progress_reporting:v0"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:protocol:worker_status:v1"\n'
INFO:apache_beam.utils.subprocess_server:b'capabilities:
"beam:version:sdk_base:apache/beam_python3.5_sdk:2.22.0.dev"\n'
INFO:apache_beam.utils.subprocess_server:b'dependencies {\n'
INFO:apache_beam.utils.subprocess_server:b' type_urn:
"beam:artifact:type:file:v1"\n'
INFO:apache_beam.utils.subprocess_server:b' type_payload:
"\\n%/tmp/tmpjgqvd537/pickled_main_session"\n'
INFO:apache_beam.utils.subprocess_server:b' role_urn:
"beam:artifact:role:staging_to:v1"\n'
INFO:apache_beam.utils.subprocess_server:b' role_payload:
"\\n\\024pickled_main_session"\n'
INFO:apache_beam.utils.subprocess_server:b'}\n'
INFO:apache_beam.utils.subprocess_server:b'\n'
INFO:apache_beam.utils.subprocess_server:b"java.io.IOException: Received exit
code 1 for command 'docker kill
65332d873bbfe009b021fddc5b1ccf9f463733b7e7cde192fca960ce6bc1eabe'. stderr:
Error response from daemon: Cannot kill container:
65332d873bbfe009b021fddc5b1ccf9f463733b7e7cde192fca960ce6bc1eabe: Container
65332d873bbfe009b021fddc5b1ccf9f463733b7e7cde192fca960ce6bc1eabe is not
running\n"
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:234)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:168)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.fnexecution.environment.DockerCommand.killContainer(DockerCommand.java:148)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment.close(DockerContainerEnvironment.java:93)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:622)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:622)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:638)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$400(DefaultJobBundleFactory.java:569)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:211)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1809)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3462)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3438)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3215)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4270)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4909)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:313)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:208)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:184)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:173)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:132)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:44)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:204)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.$closeResource(ExecutableStageDoFnOperator.java:459)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.dispose(ExecutableStageDoFnOperator.java:486)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.streaming.runtime.tasks.StreamTask.disposeAllOperators(StreamTask.java:664)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.streaming.runtime.tasks.StreamTask.afterInvoke(StreamTask.java:540)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:478)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:707)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
org.apache.flink.runtime.taskmanager.Task.run(Task.java:532)\n'
INFO:apache_beam.utils.subprocess_server:b'\tat
java.lang.Thread.run(Thread.java:748)\n'
INFO:apache_beam.utils.subprocess_server:b'[[1]write/Write/WriteImpl/FinalizeWrite
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/FinalizeWrite (1/2) (0302f93c408b07b82891e0ce742fb76c)
switched from RUNNING to FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[[1]write/Write/WriteImpl/FinalizeWrite
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for [1]write/Write/WriteImpl/FinalizeWrite (1/2)
(0302f93c408b07b82891e0ce742fb76c).\n'
INFO:apache_beam.utils.subprocess_server:b'[[1]write/Write/WriteImpl/FinalizeWrite
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all
FileSystem streams are closed for task [1]write/Write/WriteImpl/FinalizeWrite
(1/2) (0302f93c408b07b82891e0ce742fb76c) [FINISHED]\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-4]
INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task
and sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/FinalizeWrite (1/2)
0302f93c408b07b82891e0ce742fb76c.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-8]
INFO org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/FinalizeWrite (1/2) (0302f93c408b07b82891e0ce742fb76c)
switched from RUNNING to FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-8]
INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job
BeamApp-root-0415062115-356f472b (7f5530a8435a1e7d52e561b1e0d0ed9a) switched
from state RUNNING to FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-8]
INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping
checkpoint coordinator for job 7f5530a8435a1e7d52e561b1e0d0ed9a.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-8]
INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore -
Shutting down\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-7]
INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink
Mini Cluster\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-7]
INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting
down rest endpoint.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job
7f5530a8435a1e7d52e561b1e0d0ed9a reached globally terminal state FINISHED.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping
TaskExecutor akka://flink/user/taskmanager_0.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close
ResourceManager connection f8acd1127c500c9a17e4ec7e4e291699.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-4]
INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager -
Closing TaskExecutor connection 8b933d06-2190-4eef-9c75-4de51be96aa8 because:
The TaskExecutor is shutting down.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-runner-job-invoker] INFO
org.apache.beam.runners.flink.FlinkPipelineRunner - Execution finished in 11814
msecs\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-8]
INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for
job BeamApp-root-0415062115-356f472b(7f5530a8435a1e7d52e561b1e0d0ed9a).\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-runner-job-invoker] INFO
org.apache.beam.runners.flink.FlinkPipelineRunner - Final accumulator values:\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-8]
INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Suspending
SlotPool.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-8]
INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager
connection f8acd1127c500c9a17e4ec7e4e291699: JobManager is shutting down..\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-8]
INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Stopping
SlotPool.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-4]
INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager -
Disconnect job manager
a8d82fad8e3542cd7ce618275da84032@akka://flink/user/jobmanager_1 for job
7f5530a8435a1e7d52e561b1e0d0ed9a from the resource manager.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot
TaskSlot(index:0, state:ACTIVE, resource profile:
ResourceProfile{managedMemory=64.000mb (67108864 bytes), networkMemory=32.000mb
(33554432 bytes)}, allocationId: 1b4d66ecbf206d348f4cd89717fc8b88, jobId:
7f5530a8435a1e7d52e561b1e0d0ed9a).\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-runner-job-invoker] INFO
org.apache.beam.runners.flink.FlinkPipelineRunner - __metricscontainers :
MetricQueryResults(Counters(36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_11}: 1,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_format_14}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_21}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_1/SplitAndSize0:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_12}: 1,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_12:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33}:
430,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_10}: 1,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:user:sum_int64:v1
{NAMESPACE=__main__.WordExtractingDoFn,
PTRANSFORM=ref_AppliedPTransform_split_7, NAME=words}: 131,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_pair_with_one_8}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WindowInto(WindowIntoFn)_26}:
11,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/FlatMap(<lambda
at core.py:2713>)_20}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:user:sum_int64:v1
{NAMESPACE=__main__.WordExtractingDoFn,
PTRANSFORM=ref_AppliedPTransform_split_7, NAME=word_lengths}: 418,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_split_7}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_32}: 15,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_split_7}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_19:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_1/SplitAndSize0:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_13:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WindowInto(WindowIntoFn)_26}:
0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1/SplitAndSize0:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_12:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_pair_with_one_8}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_19:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)_6/SplitAndSize0}:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_12:0}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: 2,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_format_14}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_12:0}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Extract_31}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)_6/SplitAndSize0}:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_12:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WindowInto(WindowIntoFn)_26}:
11,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_19:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WindowInto(WindowIntoFn)_26}:
0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_split_7}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_9:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_12}: 1,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_32}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_32}: 403,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_9:0}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_9:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/Map(decode)_22}:
0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_19:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)_6/SplitAndSize0}:
2,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_13:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_12:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_13}: 1,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_7:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)_6/PairWithRestriction0}:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_12:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_1}: 1,
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_24}: 25,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_13:0}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_20:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_12:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)_6/ProcessSizedElementsAndRestrictions0}:
11,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Pair_25}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1/SplitAndSize0:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/Map(decode)_22}:
0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:user:sum_int64:v1
{NAMESPACE=__main__.WordExtractingDoFn,
PTRANSFORM=ref_AppliedPTransform_split_7, NAME=empty_lines}: 3,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_12:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_22}: 2,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)_6/PairWithRestriction0}:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_12}: 1,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_21:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_16:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)_6/ProcessSizedElementsAndRestrictions0}:
0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33}: 10,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_12}: 1,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_19}: 1,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1/SplitAndSize0:0}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_count_13}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/InitializeWrite_23}:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_21:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/Map(decode)_22}:
7,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_12:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1/SplitAndSize0:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_1/SplitAndSize0}: 1,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_12:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Pair_25}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_9:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Pair_25}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)_6/ProcessSizedElementsAndRestrictions0}:
11,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33}:
150,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_16:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)_6/PairWithRestriction0}:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_12:0}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_20:0}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_count_13}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_count_13}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_20:0}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_format_14}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_20:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_13:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/FlatMap(<lambda
at core.py:2713>)_20}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_16:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/FlatMap(<lambda
at core.py:2713>)_20}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_10:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_4:0}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_count_13}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)_6/ProcessSizedElementsAndRestrictions0}:
0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_3}: 131,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/InitializeWrite_23}:
0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_10:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_2}: 34,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_4}: 131,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_1/SplitAndSize0}: 1,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)_6/PairWithRestriction0}:
0, 6format.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_16}: 2,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)_6/SplitAndSize0}:
2, 6format.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_15}: 2,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/Map(decode)_22}:
7, 6format.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_14}: 2,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Extract_31}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_21:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_split_7}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_10:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_16:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_33}:
590, 6format.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_9}: 50,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_pair_with_one_8}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_10:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/InitializeWrite_23}:
11,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_9}: 50,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_8}: 50,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_4:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_1/PairWithRestriction0}: 1,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/FlatMap(<lambda
at core.py:2713>)_20}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Pair_25}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_24}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_pair_with_one_8}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)_6/SplitAndSize0,
TAG=None}: 1,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_7:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_1/SplitAndSize0:0}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_7:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)_6/PairWithRestriction0,
TAG=None}: 1,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_24}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_21:0}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_7:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_1/SplitAndSize0:0}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Extract_31}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_4:0}: 0,
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_4:0}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Extract_31}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_7}: 50,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_format_14}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_32}: 418,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_24}: 25,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/InitializeWrite_23}:
11)Distributions(40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_12}: DistributionResult{sum=15,
count=1, min=15, max=15},
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_1/PairWithRestriction0}:
DistributionResult{sum=916, count=1, min=916, max=916},
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_13}: DistributionResult{sum=115,
count=1, min=115, max=115},
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_1}: DistributionResult{sum=13,
count=1, min=13, max=13},
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)_6/SplitAndSize0,
TAG=None}: DistributionResult{sum=759, count=1, min=759, max=759},
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_12}: DistributionResult{sum=15,
count=1, min=15, max=15},
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_12}: DistributionResult{sum=15,
count=1, min=15, max=15},
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_3}: DistributionResult{sum=622,
count=37, min=14, max=23},
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_2}: DistributionResult{sum=859,
count=21, min=14, max=84},
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: DistributionResult{sum=320,
count=2, min=160, max=160},
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_4}: DistributionResult{sum=667,
count=36, min=16, max=22},
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_22}: DistributionResult{sum=174,
count=2, min=87, max=87},
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:user:distribution_int64:v1
{NAMESPACE=__main__.WordExtractingDoFn,
PTRANSFORM=ref_AppliedPTransform_split_7, NAME=word_len_dist}:
DistributionResult{sum=418, count=131, min=1, max=10},
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_19}: DistributionResult{sum=317,
count=1, min=317, max=317},
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)_6/PairWithRestriction0,
TAG=None}: DistributionResult{sum=916, count=1, min=916, max=916},
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/SplitAndSize0/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_1/SplitAndSize0}:
DistributionResult{sum=760, count=1, min=760, max=760},
6format.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_15}: DistributionResult{sum=322,
count=2, min=161, max=161},
6format.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_16}: DistributionResult{sum=322,
count=2, min=161, max=161},
6format.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_14}: DistributionResult{sum=320,
count=2, min=160, max=160},
6format.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_9}: DistributionResult{sum=807,
count=38, min=19, max=25},
42read/Read/_SDFBoundedSourceWrapper/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_1/SplitAndSize0}:
DistributionResult{sum=759, count=1, min=759, max=759},
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_21}: DistributionResult{sum=0,
count=0, min=9223372036854775807, max=-9223372036854775808},
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_7}: DistributionResult{sum=947,
count=39, min=20, max=29},
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_10}: DistributionResult{sum=13,
count=1, min=13, max=13},
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_8}: DistributionResult{sum=682,
count=35, min=17, max=26},
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_11}: DistributionResult{sum=14,
count=1, min=14, max=14},
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_9}: DistributionResult{sum=699,
count=34, min=18, max=27},
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_12}: DistributionResult{sum=14,
count=1, min=14, max=14}))\n'
INFO:apache_beam.utils.subprocess_server:b'[mini-cluster-io-thread-15] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job
7f5530a8435a1e7d52e561b1e0d0ed9a with leader id
a8d82fad8e3542cd7ce618275da84032 lost leadership.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot
TaskSlot(index:1, state:ACTIVE, resource profile:
ResourceProfile{managedMemory=64.000mb (67108864 bytes), networkMemory=32.000mb
(33554432 bytes)}, allocationId: eda7ce7dcbe00b460af60dde79bcf4a6, jobId:
7f5530a8435a1e7d52e561b1e0d0ed9a).\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job 7f5530a8435a1e7d52e561b1e0d0ed9a.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job 7f5530a8435a1e7d52e561b1e0d0ed9a.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader
service.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager -
Shutting down TaskExecutorLocalStateStoresManager.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl -
FileChannelManager removed spill file directory
/tmp/flink-io-4da23f0b-9ea2-4c27-b329-7d5eab38bfd8\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.io.network.NettyShuffleEnvironment - Shutting
down the network environment and its components.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl -
FileChannelManager removed spill file directory
/tmp/flink-netty-shuffle-5e15b15a-cb3c-416d-904a-aeb2eb9489fd\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.taskexecutor.KvStateService - Shutting down the
kvState service and its components.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader
service.\n'
INFO:apache_beam.utils.subprocess_server:b'[ForkJoinPool.commonPool-worker-2]
INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing
cache directory /tmp/flink-web-ui\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.filecache.FileCache - removed file cache
directory /tmp/flink-dist-cache-1d43ecfc-343e-4de8-94f8-d45777919946\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor
akka://flink/user/taskmanager_0.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-7]
INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down
complete.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-4]
INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Shut
down cluster because application is in CANCELED, diagnostics
DispatcherResourceManagerComponent has been closed..\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-4]
INFO
org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent
- Closing components.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-4]
INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess
- Stopping SessionDispatcherLeaderProcess.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping
dispatcher akka://flink/user/dispatcher.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all
currently running jobs of dispatcher akka://flink/user/dispatcher.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-8]
INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl -
Closing the SlotManager.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-8]
INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl -
Suspending the SlotManager.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO
org.apache.flink.runtime.rest.handler.legacy.backpressure.BackPressureRequestCoordinator
- Shutting down back pressure request coordinator.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2]
INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped
dispatcher akka://flink/user/dispatcher.\n'
INFO:apache_beam.utils.subprocess_server:b'[mini-cluster-io-thread-2] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-metrics-2] INFO
akka.remote.RemoteActorRefProvider$RemotingTerminator - Shutting down remote
daemon.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-metrics-2] INFO
akka.remote.RemoteActorRefProvider$RemotingTerminator - Remote daemon shut
down; proceeding with flushing remote transports.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-metrics-2] INFO
akka.remote.RemoteActorRefProvider$RemotingTerminator - Remoting shut down.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-metrics-2] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-metrics-2] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-8]
INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB
cache\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-8]
INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB
cache\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-8]
INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at
0.0.0.0:42875\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-8]
INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC
service.\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.AbstractLegacyArtifactRetrievalService
- Manifest at
/tmp/beam-artifact-staging/job_cdc44f6f-8804-4c79-8d1b-d2dedb5e59b2/MANIFEST
has 1 artifact locations\n'
INFO:apache_beam.utils.subprocess_server:b'[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemLegacyArtifactStagingService
- Removed dir
/tmp/beam-artifact-staging/job_cdc44f6f-8804-4c79-8d1b-d2dedb5e59b2/\n'
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
INFO:apache_beam.utils.subprocess_server:b'[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService - Getting
job metrics for
BeamApp-root-0415062115-356f472b_3f5d429e-0550-470a-bc53-7669722ec660\n'
INFO:apache_beam.utils.subprocess_server:b'[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService - Finished
getting job metrics for
BeamApp-root-0415062115-356f472b_3f5d429e-0550-470a-bc53-7669722ec660\n'
INFO:root:number of empty lines: 3
INFO:root:average word length: 3
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py35:docker'.
> Process 'command 'docker'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 13s
85 actionable tasks: 22 executed, 63 up-to-date
Publishing build scan...
https://gradle.com/s/lpumtwkm4wdoi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]