See
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1003/display/redirect>
Changes:
------------------------------------------
[...truncated 19.36 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Loading JAR files for task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map
(Key Extractor) -> GroupCombine (GroupCombine at GroupCombine:
ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (9/16)#0 (e866d7125c0cc129bbdd29a3a1ce6374) [DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (9/16)#0 (e866d7125c0cc129bbdd29a3a1ce6374) switched
from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
The operator name GroupCombine (GroupCombine at GroupCombine: ToPCollection(df)
-
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
exceeded the 80 characters length limit and was truncated.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (9/16)#0 (e866d7125c0cc129bbdd29a3a1ce6374) switched
from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
The operator name GroupCombine (GroupCombine at GroupCombine: ToPCollection(df)
-
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
exceeded the 80 characters length limit and was truncated.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Received task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key
Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (10/16)#0 (62d00fa245d00d53eeed254f43a0a530), deploy
into slot with allocation id 55ee1b05b3a881a1defa1fd7c42ac5f1.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (9/16) (e866d7125c0cc129bbdd29a3a1ce6374) switched from
DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
markExistingSlotActive
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Activate slot d97e4a2f1d4a4963ce2a1e9ecd3e2916.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (10/16)#0 (62d00fa245d00d53eeed254f43a0a530) switched
from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Loading JAR files for task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map
(Key Extractor) -> GroupCombine (GroupCombine at GroupCombine:
ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (10/16)#0 (62d00fa245d00d53eeed254f43a0a530)
[DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (10/16)#0 (62d00fa245d00d53eeed254f43a0a530) switched
from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (10/16)#0 (62d00fa245d00d53eeed254f43a0a530) switched
from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-14
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-52
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-32
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-48
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-61
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-60
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-9
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-11
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-43
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
The operator name GroupCombine (GroupCombine at GroupCombine: ToPCollection(df)
-
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
exceeded the 80 characters length limit and was truncated.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-37
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-49
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-45
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-13
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-27
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-18
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-22
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-63
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-19
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-8
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-34
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-42
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-55
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-30
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-29
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-50
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-33
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (9/16) (e866d7125c0cc129bbdd29a3a1ce6374) switched from
INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (10/16) (62d00fa245d00d53eeed254f43a0a530) switched
from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
The operator name GroupCombine (GroupCombine at GroupCombine: ToPCollection(df)
-
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
exceeded the 80 characters length limit and was truncated.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Received task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key
Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (11/16)#0 (8c0ea0b0206e8bc5b8f8b429caa7d0c9), deploy
into slot with allocation id d97e4a2f1d4a4963ce2a1e9ecd3e2916.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
The operator name GroupCombine (GroupCombine at GroupCombine: ToPCollection(df)
-
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
exceeded the 80 characters length limit and was truncated.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-21
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (10/16) (62d00fa245d00d53eeed254f43a0a530) switched
from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN MapPartition (MapPartition at [2]read
table/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>),
Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (6/16)#0
(abbd5c0f7595b5e324508d7db0c46a48) switched from RUNNING to FINISHED.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-26
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Freeing task resources for CHAIN MapPartition (MapPartition at [2]read
table/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>),
Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (6/16)#0
(abbd5c0f7595b5e324508d7db0c46a48).
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
markExistingSlotActive
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Activate slot d29686d56fdc16fe3138ebfe65299abf.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN MapPartition (MapPartition at [2]read
table/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>),
Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (3/16)#0
(60a2a426e83121b0ef7baf1d4ded90c7) switched from RUNNING to FINISHED.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-41
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Freeing task resources for CHAIN MapPartition (MapPartition at [2]read
table/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>),
Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (3/16)#0
(60a2a426e83121b0ef7baf1d4ded90c7).
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-65
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:22 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-15
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-36
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-47
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Received task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key
Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (12/16)#0 (19dd8722960ac542cd90186ac455153a), deploy
into slot with allocation id d29686d56fdc16fe3138ebfe65299abf.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-20
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 1-56
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (11/16)#0 (8c0ea0b0206e8bc5b8f8b429caa7d0c9) switched
from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Loading JAR files for task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map
(Key Extractor) -> GroupCombine (GroupCombine at GroupCombine:
ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (11/16)#0 (8c0ea0b0206e8bc5b8f8b429caa7d0c9)
[DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
markExistingSlotActive
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Activate slot 2dccae90ef326603184ddffd7ee52e22.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (11/16)#0 (8c0ea0b0206e8bc5b8f8b429caa7d0c9) switched
from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (12/16)#0 (19dd8722960ac542cd90186ac455153a) switched
from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Received task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key
Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (13/16)#0 (76f784b0b6225bdded335b5f7eec3053), deploy
into slot with allocation id 2dccae90ef326603184ddffd7ee52e22.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (11/16)#0 (8c0ea0b0206e8bc5b8f8b429caa7d0c9) switched
from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Loading JAR files for task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map
(Key Extractor) -> GroupCombine (GroupCombine at GroupCombine:
ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (12/16)#0 (19dd8722960ac542cd90186ac455153a)
[DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (11/16) (8c0ea0b0206e8bc5b8f8b429caa7d0c9) switched
from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (11/16) (8c0ea0b0206e8bc5b8f8b429caa7d0c9) switched
from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
markExistingSlotActive
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Activate slot 1f17b0788187549422cf5f35e1ccb4e8.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (12/16)#0 (19dd8722960ac542cd90186ac455153a) switched
from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
The operator name GroupCombine (GroupCombine at GroupCombine: ToPCollection(df)
-
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
exceeded the 80 characters length limit and was truncated.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Received task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key
Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (14/16)#0 (704ef681f85bc6cfed1bbeb0b8bbc0ab), deploy
into slot with allocation id 1f17b0788187549422cf5f35e1ccb4e8.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (12/16)#0 (19dd8722960ac542cd90186ac455153a) switched
from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (13/16)#0 (76f784b0b6225bdded335b5f7eec3053) switched
from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (12/16) (19dd8722960ac542cd90186ac455153a) switched
from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Loading JAR files for task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map
(Key Extractor) -> GroupCombine (GroupCombine at GroupCombine:
ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (13/16)#0 (76f784b0b6225bdded335b5f7eec3053)
[DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (12/16) (19dd8722960ac542cd90186ac455153a) switched
from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
The operator name GroupCombine (GroupCombine at GroupCombine: ToPCollection(df)
-
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
exceeded the 80 characters length limit and was truncated.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (14/16)#0 (704ef681f85bc6cfed1bbeb0b8bbc0ab) switched
from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (13/16)#0 (76f784b0b6225bdded335b5f7eec3053) switched
from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
markExistingSlotActive
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Activate slot 02b5d96726bd962387e2f28d1c2c1196.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Loading JAR files for task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map
(Key Extractor) -> GroupCombine (GroupCombine at GroupCombine:
ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (14/16)#0 (704ef681f85bc6cfed1bbeb0b8bbc0ab)
[DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (14/16)#0 (704ef681f85bc6cfed1bbeb0b8bbc0ab) switched
from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (14/16)#0 (704ef681f85bc6cfed1bbeb0b8bbc0ab) switched
from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (14/16) (704ef681f85bc6cfed1bbeb0b8bbc0ab) switched
from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
The operator name GroupCombine (GroupCombine at GroupCombine: ToPCollection(df)
-
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
exceeded the 80 characters length limit and was truncated.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Received task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key
Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (15/16)#0 (8e99f2129953778a10547debab3442d4), deploy
into slot with allocation id 02b5d96726bd962387e2f28d1c2c1196.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (13/16)#0 (76f784b0b6225bdded335b5f7eec3053) switched
from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (14/16) (704ef681f85bc6cfed1bbeb0b8bbc0ab) switched
from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (13/16) (76f784b0b6225bdded335b5f7eec3053) switched
from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
markExistingSlotActive
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Activate slot 854c7c03b0b5835c5ce845174bd128db.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (13/16) (76f784b0b6225bdded335b5f7eec3053) switched
from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Received task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key
Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (16/16)#0 (fa88cc5c906dbc0dc0dfa43d00552dd0), deploy
into slot with allocation id 854c7c03b0b5835c5ce845174bd128db.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
The operator name GroupCombine (GroupCombine at GroupCombine: ToPCollection(df)
-
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
exceeded the 80 characters length limit and was truncated.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (15/16)#0 (8e99f2129953778a10547debab3442d4) switched
from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Loading JAR files for task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map
(Key Extractor) -> GroupCombine (GroupCombine at GroupCombine:
ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (15/16)#0 (8e99f2129953778a10547debab3442d4)
[DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17,
2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) -
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey)
-> Map (Key Extractor) (16/16)#0 (fa88cc5c906dbc0dc0dfa43d00552dd0) switched
from CREATED to DEPLOYING.
> Task :sdks:python:test-suites:portable:py39:flinkExamples
PASSED [100%]
==================================== ERRORS ====================================
_ ERROR at teardown of
UserScoreIT.test_userscore_output_checksum_on_small_input _
args =
(['gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/8aca2916-6152-44c9-9ef1-460f24609475/results*'],)
kwargs = {}
retry_intervals = <generator object FuzzedExponentialIntervals.__iter__ at
0x7fbe1b734200>
exn_traceback = None, sleep_interval = 12.78335285025201
@functools.wraps(fun)
def wrapper(*args, **kwargs):
retry_intervals = iter(
FuzzedExponentialIntervals(
FAILURE: Build failed with an exception.
* What went wrong:
GC overhead limit exceeded
* Try:
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Exception is:
java.lang.OutOfMemoryError: GC overhead limit exceeded
* Get more help at https://help.gradle.org
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
