See
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/751/display/redirect>
Changes:
------------------------------------------
[...truncated 108.84 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [3]read_words/{FilesToRemoveImpulse,
MapFilesToRemove}) -> FlatMap (FlatMap at ExtractOutput[0]) (14/16)#0
(6f528961fc39492c4b774b8f90ac92e7) switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Received task CHAIN MapPartition (MapPartition at
[3]read_words/{FilesToRemoveImpulse, MapFilesToRemove}) -> FlatMap (FlatMap at
ExtractOutput[0]) (15/16)#0 (cb7ee043e0d7ad0f6380e6d44b82a9df), deploy into
slot with allocation id 1e906efcc2bd57d11958f0f733e02192.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying GroupReduce (GroupReduce at WriteToText/Write/WriteImpl/GroupByKey)
(11/16) (attempt #0) with attempt id a2e9b2e6c0b605653967ef82836fc2b0 and
vertex id 6c2258f8077f14abc1847740b15eebcc_10 to
d48d49b6-9aa1-435a-be69-cc41062d0c3b @ localhost (dataPort=-1) with allocation
id 09478377f3edb26e8d7b7d15999adb77
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
The operator name MapPartition (MapPartition at
[3]read_words/{FilesToRemoveImpulse, MapFilesToRemove}) exceeded the 80
characters length limit and was truncated.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
GroupReduce (GroupReduce at WriteToText/Write/WriteImpl/GroupByKey) (12/16)
(0e31b8fd96a31ec59e9fb0062aec0264) switched from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying GroupReduce (GroupReduce at WriteToText/Write/WriteImpl/GroupByKey)
(12/16) (attempt #0) with attempt id 0e31b8fd96a31ec59e9fb0062aec0264 and
vertex id 6c2258f8077f14abc1847740b15eebcc_11 to
d48d49b6-9aa1-435a-be69-cc41062d0c3b @ localhost (dataPort=-1) with allocation
id 201f44fd481299c3fd6f49dbaac38876
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
GroupReduce (GroupReduce at WriteToText/Write/WriteImpl/GroupByKey) (13/16)
(95287d9a1a0b94000c30e0b7d4bdbb8f) switched from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
markExistingSlotActive
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Activate slot efca433b3d2f26cbf869b2f72eb531ff.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying GroupReduce (GroupReduce at WriteToText/Write/WriteImpl/GroupByKey)
(13/16) (attempt #0) with attempt id 95287d9a1a0b94000c30e0b7d4bdbb8f and
vertex id 6c2258f8077f14abc1847740b15eebcc_12 to
d48d49b6-9aa1-435a-be69-cc41062d0c3b @ localhost (dataPort=-1) with allocation
id 0b5a2f2c9cc58a568dca159b36ef2f0f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [3]read_words/{FilesToRemoveImpulse,
MapFilesToRemove}) -> FlatMap (FlatMap at ExtractOutput[0]) (15/16)#0
(cb7ee043e0d7ad0f6380e6d44b82a9df) switched from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
GroupReduce (GroupReduce at WriteToText/Write/WriteImpl/GroupByKey) (14/16)
(e2c5fdfe281e73666260787170ec621a) switched from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Loading JAR files for task CHAIN MapPartition (MapPartition at
[3]read_words/{FilesToRemoveImpulse, MapFilesToRemove}) -> FlatMap (FlatMap at
ExtractOutput[0]) (15/16)#0 (cb7ee043e0d7ad0f6380e6d44b82a9df) [DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution deploy
ERROR root:portable_runner.py:577 java.io.IOException: Insufficient number
of network buffers: required 2, but only 1 available. The total number of
network buffers is currently set to 2048 of 32768 bytes each. You can increase
this number by setting the configuration keys
'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and
'taskmanager.memory.network.max'.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying GroupReduce (GroupReduce at WriteToText/Write/WriteImpl/GroupByKey)
(14/16) (attempt #0) with attempt id e2c5fdfe281e73666260787170ec621a and
vertex id 6c2258f8077f14abc1847740b15eebcc_13 to
d48d49b6-9aa1-435a-be69-cc41062d0c3b @ localhost (dataPort=-1) with allocation
id 7353fd9494227af231304a1ea53d973b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
GroupReduce (GroupReduce at WriteToText/Write/WriteImpl/GroupByKey) (15/16)
(197d52cc0c48ecc0431b6afecb81f5fe) switched from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying GroupReduce (GroupReduce at WriteToText/Write/WriteImpl/GroupByKey)
(15/16) (attempt #0) with attempt id 197d52cc0c48ecc0431b6afecb81f5fe and
vertex id 6c2258f8077f14abc1847740b15eebcc_14 to
d48d49b6-9aa1-435a-be69-cc41062d0c3b @ localhost (dataPort=-1) with allocation
id 1e906efcc2bd57d11958f0f733e02192
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [3]read_words/{FilesToRemoveImpulse,
MapFilesToRemove}) -> FlatMap (FlatMap at ExtractOutput[0]) (15/16)#0
(cb7ee043e0d7ad0f6380e6d44b82a9df) switched from DEPLOYING to INITIALIZING.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to FAILED
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [3]read_words/{FilesToRemoveImpulse,
MapFilesToRemove}) -> FlatMap (FlatMap at ExtractOutput[0]) (15/16)#0
(cb7ee043e0d7ad0f6380e6d44b82a9df) switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
GroupReduce (GroupReduce at WriteToText/Write/WriteImpl/GroupByKey) (16/16)
(2c621dca3e7425c9121a569239b3aed2) switched from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Received task CHAIN MapPartition (MapPartition at
[3]read_words/{FilesToRemoveImpulse, MapFilesToRemove}) -> FlatMap (FlatMap at
ExtractOutput[0]) (16/16)#0 (98d9f60115037d025bebecd5c8236dfa), deploy into
slot with allocation id efca433b3d2f26cbf869b2f72eb531ff.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
The operator name MapPartition (MapPartition at
[3]read_words/{FilesToRemoveImpulse, MapFilesToRemove}) exceeded the 80
characters length limit and was truncated.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying GroupReduce (GroupReduce at WriteToText/Write/WriteImpl/GroupByKey)
(16/16) (attempt #0) with attempt id 2c621dca3e7425c9121a569239b3aed2 and
vertex id 6c2258f8077f14abc1847740b15eebcc_15 to
d48d49b6-9aa1-435a-be69-cc41062d0c3b @ localhost (dataPort=-1) with allocation
id efca433b3d2f26cbf869b2f72eb531ff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]WriteToText/Write/WriteImpl/Extract) ->
FlatMap (FlatMap at ExtractOutput[0]) (1/16) (a8108fe866e761dd7dc8235a7ab14ca4)
switched from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying CHAIN MapPartition (MapPartition at
[1]WriteToText/Write/WriteImpl/Extract) -> FlatMap (FlatMap at
ExtractOutput[0]) (1/16) (attempt #0) with attempt id
a8108fe866e761dd7dc8235a7ab14ca4 and vertex id
dfcce5cb6c7cfb387a68abd4260ecd50_0 to d48d49b6-9aa1-435a-be69-cc41062d0c3b @
localhost (dataPort=-1) with allocation id dcc715b743b399e4c505f043e2a4cfdc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]WriteToText/Write/WriteImpl/Extract) ->
FlatMap (FlatMap at ExtractOutput[0]) (2/16) (09014b810bf870f0d800796e04d8220b)
switched from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying CHAIN MapPartition (MapPartition at
[1]WriteToText/Write/WriteImpl/Extract) -> FlatMap (FlatMap at
ExtractOutput[0]) (2/16) (attempt #0) with attempt id
09014b810bf870f0d800796e04d8220b and vertex id
dfcce5cb6c7cfb387a68abd4260ecd50_1 to d48d49b6-9aa1-435a-be69-cc41062d0c3b @
localhost (dataPort=-1) with allocation id 74338ff0b2772bad47286afbbe13f931
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]WriteToText/Write/WriteImpl/Extract) ->
FlatMap (FlatMap at ExtractOutput[0]) (3/16) (17c2a6e111df99c1e7a530ef1e442b7c)
switched from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying CHAIN MapPartition (MapPartition at
[1]WriteToText/Write/WriteImpl/Extract) -> FlatMap (FlatMap at
ExtractOutput[0]) (3/16) (attempt #0) with attempt id
17c2a6e111df99c1e7a530ef1e442b7c and vertex id
dfcce5cb6c7cfb387a68abd4260ecd50_2 to d48d49b6-9aa1-435a-be69-cc41062d0c3b @
localhost (dataPort=-1) with allocation id 120b64dfd85bd89ba0b0c85a206e5cc7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]WriteToText/Write/WriteImpl/Extract) ->
FlatMap (FlatMap at ExtractOutput[0]) (4/16) (1325130748a3734e4a58206d648ac7dc)
switched from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying CHAIN MapPartition (MapPartition at
[1]WriteToText/Write/WriteImpl/Extract) -> FlatMap (FlatMap at
ExtractOutput[0]) (4/16) (attempt #0) with attempt id
1325130748a3734e4a58206d648ac7dc and vertex id
dfcce5cb6c7cfb387a68abd4260ecd50_3 to d48d49b6-9aa1-435a-be69-cc41062d0c3b @
localhost (dataPort=-1) with allocation id 4c4825c364c0fef1a12060d7e2270ffd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]WriteToText/Write/WriteImpl/Extract) ->
FlatMap (FlatMap at ExtractOutput[0]) (5/16) (bd00aaaaaa64618ada98ed87a00fe657)
switched from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
getProcessBundleDescriptor request with id 2-21
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 15,
2022 3:43:40 AM org.apache.flink.runtime.executiongraph.Execution deploy
--------------------------- Captured stdout teardown ---------------------------
FAILED [ 56%]
---------------------------- Captured log teardown -----------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Partition (15/16)#0 (4a954072242e9c77265c7b04c5365e60) switched from DEPLOYING
to FAILED with failure cause: java.io.IOException: Insufficient number of
network buffers: required 2, but only 0 available. The total number of network
buffers is currently set to 2048 of 32768 bytes each. You can increase this
number by setting the configuration keys 'taskmanager.memory.network.fraction',
'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at
org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2285:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2291:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1129:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1131:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2774:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2776:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2807:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
| _PassThroughThenCleanup(files_to_remove_pcoll))
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2281:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47:
FutureWarning: Dropping of nuisance columns in DataFrame reductions (with
'numeric_only=None') is deprecated; in a future version this will raise
TypeError. Select only valid columns before calling the reduction.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:632:
FutureWarning: WriteToFiles is experimental.
sink=lambda _: _WriteToPandasFileSink(
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
Exception in thread read_grpc_client_inputs:
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:581:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
Traceback (most recent call last):
File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml>
-
=========================== short test summary info ============================
FAILED
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
= 1 failed, 21 passed, 3 skipped, 6527 deselected, 39 warnings in 478.52s
(0:07:58) =
File "/usr/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 671, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 654, in _read_inputs
for elements in elements_iterator:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
line 426, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string =
"{"created":"@1660535089.769961183","description":"Error received from peer
ipv6:[::1]:37999","file":"src/core/lib/surface/call.cc","file_line":966,"grpc_message":"Multiplexer
hanging up","grpc_status":1}"
>
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/usr/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 671, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 654, in _read_inputs
for elements in elements_iterator:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
line 426, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string =
"{"created":"@1660535090.426771640","description":"Error received from peer
ipv6:[::1]:45555","file":"src/core/lib/surface/call.cc","file_line":966,"grpc_message":"Multiplexer
hanging up","grpc_status":1}"
>
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 240
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 240
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 39s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/6vwe3ospax2pw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
