See
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/794/display/redirect?page=changes>
Changes:
[Robert Bradshaw] [BEAM-22723] Yield BatchElement batches at end of window.
[noreply] Update sdks/python/apache_beam/transforms/util_test.py
[noreply] [Website] add Python to KinesisIO in connectors #22845 (#22841)
[noreply] Combining state integration test (#22846)
[noreply] Small lint fixes (#22890)
------------------------------------------
[...truncated 109.06 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (13/16) (7a8f504448c751edb11a31ef0d5c17e9) switched from
DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
getProcessBundleDescriptor request with id 3-13
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
getProcessBundleDescriptor request with id 3-30
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Freeing task resources for DataSource (Impulse) (9/16)#0
(1603d9e317d10b5863f74c70fd23deba).
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (13/16) (7a8f504448c751edb11a31ef0d5c17e9) switched from
INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (14/16) (04d3109b276b1b300ebb8673921de297) switched from
DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (14/16) (04d3109b276b1b300ebb8673921de297) switched from
INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (15/16) (c6614b3c491f008383b169ca1903ddc2) switched from
DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (15/16) (c6614b3c491f008383b169ca1903ddc2) switched from
INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (10/16)#0 (235ec414a0286929ab107c833859bebb) switched from
RUNNING to FINISHED.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (16/16) (5f7c714fbb7981e59f474923c5b20c2e) switched from
DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Freeing task resources for DataSource (Impulse) (10/16)#0
(235ec414a0286929ab107c833859bebb).
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (12/16)#0 (c63811171d0ff67446df6dac5afbdbaa) switched from
RUNNING to FINISHED.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (4/16)#0 (f7d3dba78a3dd4a4a3b1563460bb3381) switched from
RUNNING to FINISHED.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (11/16)#0 (d0d3a822e9fde4fb0dc739d11a30099f) switched from
RUNNING to FINISHED.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (16/16) (5f7c714fbb7981e59f474923c5b20c2e) switched from
INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
markExistingSlotActive
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Activate slot 4e96c73ad133da4f1c006cdbed693eaa.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (15/16)#0 (fcf09dbb0653ea4283c2fd17e7415e43) switched from
RUNNING to FINISHED.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Freeing task resources for DataSource (Impulse) (15/16)#0
(fcf09dbb0653ea4283c2fd17e7415e43).
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Freeing task resources for DataSource (Impulse) (12/16)#0
(c63811171d0ff67446df6dac5afbdbaa).
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Received task CHAIN MapPartition (MapPartition at
[2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at
core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0])
(11/16)#0 (872b6bd561ce70a1a429a5bfda483d9f), deploy into slot with allocation
id 4e96c73ad133da4f1c006cdbed693eaa.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Freeing task resources for DataSource (Impulse) (11/16)#0
(d0d3a822e9fde4fb0dc739d11a30099f).
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (1/16) (37c3df14caa0e897418bfb92a7ba7e79) switched from
DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task transitionState
ERROR root:portable_runner.py:577 java.io.IOException: Insufficient number
of network buffers: required 1, but only 0 available. The total number of
network buffers is currently set to 2048 of 32768 bytes each. You can increase
this number by setting the configuration keys
'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and
'taskmanager.memory.network.max'.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (13/16)#0 (7a8f504448c751edb11a31ef0d5c17e9) switched from
RUNNING to FINISHED.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (14/16)#0 (04d3109b276b1b300ebb8673921de297) switched from
RUNNING to FINISHED.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to FAILED
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at
[2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at
core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0])
(10/16)#0 (ce7fbd99818d0a73099139a9334036c4) switched from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Loading JAR files for task CHAIN MapPartition (MapPartition at
[2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at
core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0])
(10/16)#0 (ce7fbd99818d0a73099139a9334036c4) [DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (1/16) (37c3df14caa0e897418bfb92a7ba7e79) switched from
INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at
[2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at
core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0])
(10/16)#0 (ce7fbd99818d0a73099139a9334036c4) switched from DEPLOYING to
INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at
[2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at
core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0])
(10/16)#0 (ce7fbd99818d0a73099139a9334036c4) switched from INITIALIZING to
RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (2/16) (5457ec397ac1b2dd083fbc7765e52e7f) switched from
DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
The operator name MapPartition (MapPartition at
[2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at
core.py:3481>), Map(decode)}) exceeded the 80 characters length limit and was
truncated.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (2/16) (5457ec397ac1b2dd083fbc7765e52e7f) switched from
INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Freeing task resources for DataSource (Impulse) (4/16)#0
(f7d3dba78a3dd4a4a3b1563460bb3381).
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (16/16)#0 (5f7c714fbb7981e59f474923c5b20c2e) switched from
RUNNING to FINISHED.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Freeing task resources for DataSource (Impulse) (16/16)#0
(5f7c714fbb7981e59f474923c5b20c2e).
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Freeing task resources for DataSource (Impulse) (14/16)#0
(04d3109b276b1b300ebb8673921de297).
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Freeing task resources for DataSource (Impulse) (13/16)#0
(7a8f504448c751edb11a31ef0d5c17e9).
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at
[2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at
core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0])
(11/16)#0 (872b6bd561ce70a1a429a5bfda483d9f) switched from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
markExistingSlotActive
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Activate slot 276ae1ae0f7478cdf0cde584ecf6b2ca.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Loading JAR files for task CHAIN MapPartition (MapPartition at
[2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at
core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0])
(11/16)#0 (872b6bd561ce70a1a429a5bfda483d9f) [DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at
[2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at
core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0])
(11/16)#0 (872b6bd561ce70a1a429a5bfda483d9f) switched from DEPLOYING to
INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at
[2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at
core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0])
(11/16)#0 (872b6bd561ce70a1a429a5bfda483d9f) switched from INITIALIZING to
RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:05 PM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
--------------------------- Captured stdout teardown ---------------------------
FAILED [ 56%]
---------------------------- Captured log teardown -----------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:07 PM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Received task CHAIN MapPartition (MapPartition at [2]{attach word,
WriteToText}) -> FlatMap (FlatMap at ExtractOutput[0]) (7/16)#0
(86debeee664face0356a413bc7729b35), deploy into slot with allocation id
e214c5fd2eeafc39e31d813d86f2015f.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:07 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
markExistingSlotActive
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Activate slot 78ae98b7a9b4401c2a55c9ba1d50abf8.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:07 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]) (7/16)#0 (86debeee664face0356a413bc7729b35)
switched from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:07 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Loading JAR files for task CHAIN MapPartition (MapPartition at [2]{attach word,
WriteToText}) -> FlatMap (FlatMap at ExtractOutput[0]) (7/16)#0
(86debeee664face0356a413bc7729b35) [DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 25,
2022 9:45:07 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
CHAIN MapPartition (MapPartition at [2]{attach word, WriteToText}) -> FlatMap
(FlatMap at ExtractOutput[0]) (7/16)#0 (86debeee664face0356a413bc7729b35)
switched from DEPLOYING to FAILED with failure cause: java.io.IOException:
Insufficient number of network buffers: required 2, but only 1 available. The
total number of network buffers is currently set to 2048 of 32768 bytes each.
You can increase this number by setting the configuration keys
'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and
'taskmanager.memory.network.max'.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at
org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at
org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at
org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at
org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at
org.apache.flink.runtime.io.network.partition.BufferWritingResultPartition.setup(BufferWritingResultPartition.java:97)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at
org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at
org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at
org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2285:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2291:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1129:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1131:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2774:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2776:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2807:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
| _PassThroughThenCleanup(files_to_remove_pcoll))
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2281:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47:
FutureWarning: Dropping of nuisance columns in DataFrame reductions (with
'numeric_only=None') is deprecated; in a future version this will raise
TypeError. Select only valid columns before calling the reduction.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:632:
FutureWarning: WriteToFiles is experimental.
sink=lambda _: _WriteToPandasFileSink(
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:581:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml>
-
=========================== short test summary info ============================
FAILED
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
= 1 failed, 21 passed, 3 skipped, 6529 deselected, 39 warnings in 577.04s
(0:09:37) =
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 240
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 240
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 33s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/fhxravqcreqfe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
