See
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/779/display/redirect?page=changes>
Changes:
[noreply] Bump cloud.google.com/go/bigquery from 1.37.0 to 1.38.0 in /sdks
------------------------------------------
[...truncated 100.31 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSink (DiscardingOutput) (4/16) (5a500e75eaf7bc058904b908ffbcbf32) switched
from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at
core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (7/16)#0
(ec652f93a314b541b17404d1db8a4933) switched from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
control
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Beam Fn Control client connected with id 2-1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying DataSink (DiscardingOutput) (4/16) (attempt #0) with attempt id
5a500e75eaf7bc058904b908ffbcbf32 and vertex id
4f4ad0805a41c32621e764b06aefdd3c_3 to f63b22c6-927e-4878-aff5-b40b75d789ab @
localhost (dataPort=-1) with allocation id 0115b1afd131139bc0cbaa42316a0075
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSink (DiscardingOutput) (5/16) (0e665ccce103abaf061c453dcb5f321a) switched
from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying DataSink (DiscardingOutput) (5/16) (attempt #0) with attempt id
0e665ccce103abaf061c453dcb5f321a and vertex id
4f4ad0805a41c32621e764b06aefdd3c_4 to f63b22c6-927e-4878-aff5-b40b75d789ab @
localhost (dataPort=-1) with allocation id dea0334acd94bbb64aefa3ba3ced8021
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSink (DiscardingOutput) (6/16) (895f63dfcc9c5cebf8d5a53a43e71145) switched
from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying DataSink (DiscardingOutput) (6/16) (attempt #0) with attempt id
895f63dfcc9c5cebf8d5a53a43e71145 and vertex id
4f4ad0805a41c32621e764b06aefdd3c_5 to f63b22c6-927e-4878-aff5-b40b75d789ab @
localhost (dataPort=-1) with allocation id d3ca16f326f504e7612b3c802b13c37e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSink (DiscardingOutput) (7/16) (e0c5864545471f9b0de0abd5946e7b0f) switched
from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying DataSink (DiscardingOutput) (7/16) (attempt #0) with attempt id
e0c5864545471f9b0de0abd5946e7b0f and vertex id
4f4ad0805a41c32621e764b06aefdd3c_6 to f63b22c6-927e-4878-aff5-b40b75d789ab @
localhost (dataPort=-1) with allocation id bad7a1441d5a4cf04c430e21ce3b8e48
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSink (DiscardingOutput) (8/16) (18f22ccc74b38ca928cce1114999bfe5) switched
from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution deploy
ERROR root:portable_runner.py:577 java.io.IOException: Insufficient number
of network buffers: required 17, but only 10 available. The total number of
network buffers is currently set to 2048 of 32768 bytes each. You can increase
this number by setting the configuration keys
'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and
'taskmanager.memory.network.max'.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying DataSink (DiscardingOutput) (8/16) (attempt #0) with attempt id
18f22ccc74b38ca928cce1114999bfe5 and vertex id
4f4ad0805a41c32621e764b06aefdd3c_7 to f63b22c6-927e-4878-aff5-b40b75d789ab @
localhost (dataPort=-1) with allocation id 549a20780e725b68b4bdc1cce6865bb9
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSink (DiscardingOutput) (9/16) (658baaab1f4c6826e616236a9b598b09) switched
from SCHEDULED to DEPLOYING.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to FAILED
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying DataSink (DiscardingOutput) (9/16) (attempt #0) with attempt id
658baaab1f4c6826e616236a9b598b09 and vertex id
4f4ad0805a41c32621e764b06aefdd3c_8 to f63b22c6-927e-4878-aff5-b40b75d789ab @
localhost (dataPort=-1) with allocation id 15e6b77dc501e78afed43ec9d716ad9e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSink (DiscardingOutput) (10/16) (8e80b0fc93f201b5b4498a727da05396) switched
from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying DataSink (DiscardingOutput) (10/16) (attempt #0) with attempt id
8e80b0fc93f201b5b4498a727da05396 and vertex id
4f4ad0805a41c32621e764b06aefdd3c_9 to f63b22c6-927e-4878-aff5-b40b75d789ab @
localhost (dataPort=-1) with allocation id 8731275cd572975cfe7ad5cccd5344a8
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSink (DiscardingOutput) (11/16) (b883056cce4fb72aecfd5e9c5a0f59c2) switched
from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Loading JAR files for task CHAIN MapPartition (MapPartition at
[2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) ->
FlatMap (FlatMap at ExtractOutput[0]) (7/16)#0
(ec652f93a314b541b17404d1db8a4933) [DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying DataSink (DiscardingOutput) (11/16) (attempt #0) with attempt id
b883056cce4fb72aecfd5e9c5a0f59c2 and vertex id
4f4ad0805a41c32621e764b06aefdd3c_10 to f63b22c6-927e-4878-aff5-b40b75d789ab @
localhost (dataPort=-1) with allocation id 728142b489e30bc12c0780fa96922b58
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSink (DiscardingOutput) (12/16) (51ea702e2a347d6da6b03a56ba1fb463) switched
from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at
core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (7/16)#0
(ec652f93a314b541b17404d1db8a4933) switched from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying DataSink (DiscardingOutput) (12/16) (attempt #0) with attempt id
51ea702e2a347d6da6b03a56ba1fb463 and vertex id
4f4ad0805a41c32621e764b06aefdd3c_11 to f63b22c6-927e-4878-aff5-b40b75d789ab @
localhost (dataPort=-1) with allocation id 6edf825726b00e902bfc6bcbaa0acc7b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at
core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (7/16)#0
(ec652f93a314b541b17404d1db8a4933) switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Received task CHAIN MapPartition (MapPartition at
[2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) ->
FlatMap (FlatMap at ExtractOutput[0]) (8/16)#0
(584524764eae3e4680c074a5ad653791), deploy into slot with allocation id
549a20780e725b68b4bdc1cce6865bb9.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
The operator name MapPartition (MapPartition at
[2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)})
exceeded the 80 characters length limit and was truncated.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSink (DiscardingOutput) (13/16) (5604152daa7093a46d50a85e7e9032b4) switched
from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying DataSink (DiscardingOutput) (13/16) (attempt #0) with attempt id
5604152daa7093a46d50a85e7e9032b4 and vertex id
4f4ad0805a41c32621e764b06aefdd3c_12 to f63b22c6-927e-4878-aff5-b40b75d789ab @
localhost (dataPort=-1) with allocation id dd2d390390d9483eb626d5040c8768f2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
markExistingSlotActive
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Activate slot 15e6b77dc501e78afed43ec9d716ad9e.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at
core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (8/16)#0
(584524764eae3e4680c074a5ad653791) switched from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSink (DiscardingOutput) (14/16) (b861ac8a7938c491196fd34e3e291658) switched
from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Loading JAR files for task CHAIN MapPartition (MapPartition at
[2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) ->
FlatMap (FlatMap at ExtractOutput[0]) (8/16)#0
(584524764eae3e4680c074a5ad653791) [DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying DataSink (DiscardingOutput) (14/16) (attempt #0) with attempt id
b861ac8a7938c491196fd34e3e291658 and vertex id
4f4ad0805a41c32621e764b06aefdd3c_13 to f63b22c6-927e-4878-aff5-b40b75d789ab @
localhost (dataPort=-1) with allocation id 8c0f18c702428dc6d61dbe2d485a0a6f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSink (DiscardingOutput) (15/16) (8aff4e42fd31da37e3371a780772e99e) switched
from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at
core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (8/16)#0
(584524764eae3e4680c074a5ad653791) switched from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying DataSink (DiscardingOutput) (15/16) (attempt #0) with attempt id
8aff4e42fd31da37e3371a780772e99e and vertex id
4f4ad0805a41c32621e764b06aefdd3c_14 to f63b22c6-927e-4878-aff5-b40b75d789ab @
localhost (dataPort=-1) with allocation id f36114df05a7b26406080403ea540d24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at
core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (8/16)#0
(584524764eae3e4680c074a5ad653791) switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
The operator name MapPartition (MapPartition at
[2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)})
exceeded the 80 characters length limit and was truncated.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Received task CHAIN MapPartition (MapPartition at
[2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) ->
FlatMap (FlatMap at ExtractOutput[0]) (9/16)#0
(18a2200c719674a911bee41d464dc00d), deploy into slot with allocation id
15e6b77dc501e78afed43ec9d716ad9e.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSink (DiscardingOutput) (16/16) (3c4dc5319b4d27c3e7619ff7870df605) switched
from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying DataSink (DiscardingOutput) (16/16) (attempt #0) with attempt id
3c4dc5319b4d27c3e7619ff7870df605 and vertex id
4f4ad0805a41c32621e764b06aefdd3c_15 to f63b22c6-927e-4878-aff5-b40b75d789ab @
localhost (dataPort=-1) with allocation id e83607572a854e037d4bbdfe48618562
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (1/16) (d066333b538e5bca7b56063931c7d235) switched from
DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:34 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
DataSource (Impulse) (1/16) (d066333b538e5bca7b56063931c7d235) switched from
INITIALIZING to RUNNING.
---------------------------- Captured log teardown -----------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInLocal'. Metric will not be reported.[, taskmanager,
f63b22c6-927e-4878-aff5-b40b75d789ab, BeamApp-jenkins-0822034327-edb106a,
MapPartition (MapPartition at [1]read
corpus/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)), 1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:36 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInLocalPerSecond'. Metric will not be reported.[, taskmanager,
f63b22c6-927e-4878-aff5-b40b75d789ab, BeamApp-jenkins-0822034327-edb106a,
MapPartition (MapPartition at [1]read
corpus/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)), 1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 22,
2022 3:43:36 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2285:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2291:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1129:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1131:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2774:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2776:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2807:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
| _PassThroughThenCleanup(files_to_remove_pcoll))
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2281:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47:
FutureWarning: Dropping of nuisance columns in DataFrame reductions (with
'numeric_only=None') is deprecated; in a future version this will raise
TypeError. Select only valid columns before calling the reduction.
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/usr/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 671, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 654, in _read_inputs
for elements in elements_iterator:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
line 426, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string =
"{"created":"@1661139907.601021096","description":"Error received from peer
ipv6:[::1]:32939","file":"src/core/lib/surface/call.cc","file_line":966,"grpc_message":"Multiplexer
hanging up","grpc_status":1}"
>
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:632:
FutureWarning: WriteToFiles is experimental.
sink=lambda _: _WriteToPandasFileSink(
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:581:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml>
-
=========================== short test summary info ============================
FAILED
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
= 1 failed, 21 passed, 3 skipped, 6528 deselected, 39 warnings in 492.44s
(0:08:12) =
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 240
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 240
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 53s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/h2ffjn5ew4uug
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
