See
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/735/display/redirect?page=changes>
Changes:
[chamikaramj] Update vendored gRPC version for SpannerTransformRegistrarTest
[noreply] [Playground] Share any code feature frontend (#22477)
[noreply] Remove subprocess.PIPE usage by using a temp file (#22654)
[noreply] [#22647] Upgrade org.apache.samza to 1.6 (#22648)
------------------------------------------
[...truncated 109.54 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInLocal'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInLocalPerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInLocal'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInLocalPerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInRemote'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInRemotePerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInRemote'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInRemotePerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInLocal'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInLocalPerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInLocal'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInLocalPerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInRemote'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInRemotePerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInRemote'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInRemotePerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInLocal'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInLocalPerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInLocal'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInLocalPerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInRemote'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInRemotePerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInRemote'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInRemotePerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInLocal'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInLocalPerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInLocal'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInLocalPerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInRemote'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInRemotePerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInRemote'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInRemotePerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 11]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Received task CHAIN MapPartition (MapPartition at [2]{attach word,
WriteToText}) -> FlatMap (FlatMap at ExtractOutput[0]) (12/16)#0
(161f220f73e514450d23a604b0e0a902), deploy into slot with allocation id
84075dc68035d6dd54e1f5f8670030e3.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]) (12/16)#0 (161f220f73e514450d23a604b0e0a902)
switched from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
markExistingSlotActive
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Activate slot 43ede38d6eab31d139d7ed9c5b0f00e0.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Loading JAR files for task CHAIN MapPartition (MapPartition at [2]{attach word,
WriteToText}) -> FlatMap (FlatMap at ExtractOutput[0]) (12/16)#0
(161f220f73e514450d23a604b0e0a902) [DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]) (12/16)#0 (161f220f73e514450d23a604b0e0a902)
switched from DEPLOYING to FAILED with failure cause: java.io.IOException:
Insufficient number of network buffers: required 1, but only 0 available. The
total number of network buffers is currently set to 2048 of 32768 bytes each.
You can increase this number by setting the configuration keys
'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and
'taskmanager.memory.network.max'.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at
org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at
org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:451)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at
org.apache.flink.runtime.io.network.partition.consumer.SingleInputGateFactory.lambda$createBufferPoolFactory$3(SingleInputGateFactory.java:306)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at
org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.setup(SingleInputGate.java:274)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at
org.apache.flink.runtime.taskmanager.InputGateWithMetrics.setup(InputGateWithMetrics.java:105)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at
org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:965)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at
org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at
org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at
java.lang.Thread.run(Thread.java:750)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Freeing task resources for CHAIN MapPartition (MapPartition at [2]{attach word,
WriteToText}) -> FlatMap (FlatMap at ExtractOutput[0]) (12/16)#0
(161f220f73e514450d23a604b0e0a902).
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInLocal'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 12, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInLocalPerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 12, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInLocal'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 12]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInLocalPerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 12]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInRemote'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 12, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInRemotePerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 12, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInRemote'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 12]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBytesInRemotePerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 12]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInLocal'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 12, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInLocalPerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 12, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInLocal'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 12]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 11,
2022 3:43:56 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInLocalPerSecond'. Metric will not be reported.[, taskmanager,
3357a931-ace3-4bb8-b8a6-78620debe276, BeamApp-jenkins-0811034345-4acf5112,
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]), 12]
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2285:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2291:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1129:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1131:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2774:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2776:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2807:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
| _PassThroughThenCleanup(files_to_remove_pcoll))
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2281:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47:
FutureWarning: Dropping of nuisance columns in DataFrame reductions (with
'numeric_only=None') is deprecated; in a future version this will raise
TypeError. Select only valid columns before calling the reduction.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:632:
FutureWarning: WriteToFiles is experimental.
sink=lambda _: _WriteToPandasFileSink(
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:581:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml>
-
=========================== short test summary info ============================
FAILED
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
= 1 failed, 21 passed, 3 skipped, 6517 deselected, 39 warnings in 497.78s
(0:08:17) =
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 240
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 240
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 2s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qo742p7qsgq3w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
