See
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/831/display/redirect?page=changes>
Changes:
[noreply] [#19857] Migrate to using a memory aware cache within the Python SDK
------------------------------------------
[...truncated 109.28 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
markExistingSlotActive
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Activate slot 17f781d636b4892a1d04a1011465ae4e.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Loading JAR files for task CHAIN MapPartition (MapPartition at [1]create
groups/Map(decode)) -> FlatMap (FlatMap at ExtractOutput[0]) (9/16)#0
(a300982768ed3edd0efef5cd840e2d31) [DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (9/16)#0 (a300982768ed3edd0efef5cd840e2d31)
switched from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (9/16)#0 (a300982768ed3edd0efef5cd840e2d31)
switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Received task CHAIN MapPartition (MapPartition at [1]create groups/Map(decode))
-> FlatMap (FlatMap at ExtractOutput[0]) (10/16)#0
(84d1f946cc776c151d33f723c26030ef), deploy into slot with allocation id
17f781d636b4892a1d04a1011465ae4e.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (10/16)#0 (84d1f946cc776c151d33f723c26030ef)
switched from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Loading JAR files for task CHAIN MapPartition (MapPartition at [1]create
groups/Map(decode)) -> FlatMap (FlatMap at ExtractOutput[0]) (10/16)#0
(84d1f946cc776c151d33f723c26030ef) [DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (9/16) (a300982768ed3edd0efef5cd840e2d31)
switched from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (10/16)#0 (84d1f946cc776c151d33f723c26030ef)
switched from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (9/16) (a300982768ed3edd0efef5cd840e2d31)
switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (10/16)#0 (84d1f946cc776c151d33f723c26030ef)
switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
markExistingSlotActive
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Activate slot 1e863b72c30386825ca01197bc88d18d.
ERROR root:portable_runner.py:577 java.io.IOException: Insufficient number
of network buffers: required 17, but only 2 available. The total number of
network buffers is currently set to 2048 of 32768 bytes each. You can increase
this number by setting the configuration keys
'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and
'taskmanager.memory.network.max'.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Received task CHAIN MapPartition (MapPartition at [1]create groups/Map(decode))
-> FlatMap (FlatMap at ExtractOutput[0]) (11/16)#0
(f4f87fb96d5ce0bec1bdb43914cbc517), deploy into slot with allocation id
1e863b72c30386825ca01197bc88d18d.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (10/16) (84d1f946cc776c151d33f723c26030ef)
switched from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (10/16) (84d1f946cc776c151d33f723c26030ef)
switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
getProcessBundleDescriptor request with id 2-6
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to FAILED
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/FlatMap(<lambda at
core.py:3481>)) -> FlatMap (FlatMap at ExtractOutput[0]) (11/16)#0
(a060a1c1ce2251eb3ef0118911a1c381) switched from RUNNING to FINISHED.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Freeing task resources for CHAIN MapPartition (MapPartition at [1]create
groups/FlatMap(<lambda at core.py:3481>)) -> FlatMap (FlatMap at
ExtractOutput[0]) (11/16)#0 (a060a1c1ce2251eb3ef0118911a1c381).
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
getProcessBundleDescriptor request with id 2-3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
markExistingSlotActive
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Activate slot e4866194dfe04435b240ebe0d2a53205.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Received task CHAIN MapPartition (MapPartition at [1]create groups/Map(decode))
-> FlatMap (FlatMap at ExtractOutput[0]) (12/16)#0
(8a2767bc74394fa8cd75d32f983edaa2), deploy into slot with allocation id
e4866194dfe04435b240ebe0d2a53205.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (12/16)#0 (8a2767bc74394fa8cd75d32f983edaa2)
switched from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
markExistingSlotActive
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Activate slot 10c8e4e5e859f5d561c8b21aa44a314e.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Loading JAR files for task CHAIN MapPartition (MapPartition at [1]create
groups/Map(decode)) -> FlatMap (FlatMap at ExtractOutput[0]) (12/16)#0
(8a2767bc74394fa8cd75d32f983edaa2) [DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (12/16)#0 (8a2767bc74394fa8cd75d32f983edaa2)
switched from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (12/16) (8a2767bc74394fa8cd75d32f983edaa2)
switched from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (12/16)#0 (8a2767bc74394fa8cd75d32f983edaa2)
switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (12/16) (8a2767bc74394fa8cd75d32f983edaa2)
switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Received task CHAIN MapPartition (MapPartition at [1]create groups/Map(decode))
-> FlatMap (FlatMap at ExtractOutput[0]) (13/16)#0
(a848ce8149dfbeb4c5b9be75e56f2b82), deploy into slot with allocation id
10c8e4e5e859f5d561c8b21aa44a314e.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (11/16)#0 (f4f87fb96d5ce0bec1bdb43914cbc517)
switched from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Loading JAR files for task CHAIN MapPartition (MapPartition at [1]create
groups/Map(decode)) -> FlatMap (FlatMap at ExtractOutput[0]) (11/16)#0
(f4f87fb96d5ce0bec1bdb43914cbc517) [DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (11/16)#0 (f4f87fb96d5ce0bec1bdb43914cbc517)
switched from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (11/16)#0 (f4f87fb96d5ce0bec1bdb43914cbc517)
switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (11/16) (f4f87fb96d5ce0bec1bdb43914cbc517)
switched from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (11/16) (f4f87fb96d5ce0bec1bdb43914cbc517)
switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
markExistingSlotActive
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Activate slot 7c0c2e3812d180b334b4199dfb03d210.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]create groups/Map(decode)) -> FlatMap
(FlatMap at ExtractOutput[0]) (13/16)#0 (a848ce8149dfbeb4c5b9be75e56f2b82)
switched from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:43 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Loading JAR files for task CHAIN MapPartition (MapPartition at [1]create
groups/Map(decode)) -> FlatMap (FlatMap at ExtractOutput[0]) (13/16)#0
(a848ce8149dfbeb4c5b9be75e56f2b82) [DEPLOYING].
---------------------------- Captured log teardown -----------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInLocalPerSecond'. Metric will not be reported.[, taskmanager,
639c0b41-bb7f-4637-87b9-400192c4a6f0, BeamApp-jenkins-0904034433-32c3361a,
CHAIN MapPartition (MapPartition at
[2]WriteToText/Write/WriteImpl/{WriteBundles, Pair}) -> FlatMap (FlatMap at
ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at
GroupCombine: WriteToText/Write/WriteImpl/GroupByKey) -> Map (Key Extractor), 6]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:45 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Name collision: Group already contains a Metric with the name
'numBuffersInRemote'. Metric will not be reported.[, taskmanager,
639c0b41-bb7f-4637-87b9-400192c4a6f0, BeamApp-jenkins-0904034433-32c3361a,
CHAIN MapPartition (MapPartition at
[2]WriteToText/Write/WriteImpl/{WriteBundles, Pair}) -> FlatMap (FlatMap at
ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at
GroupCombine: WriteToText/Write/WriteImpl/GroupByKey) -> Map (Key Extractor),
6, Shuffle, Netty, Input]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Sep 04,
2022 3:44:45 AM org.apache.flink.runtime.metrics.groups.AbstractMetricGroup
addMetric
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/2022703441/lib/python3.7/site-packages/google/api_core/grpc_helpers.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/google/api_core/grpc_helpers.py>:42:
DeprecationWarning: Support for grpcio-gcp is deprecated. This feature will be
removed from `google-api-core` after January 1, 2024. If you need
to
continue to use this feature, please pin to a specific version of
`google-api-core`.
DeprecationWarning,
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2285:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2291:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1129:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1131:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2774:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2776:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2807:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
| _PassThroughThenCleanup(files_to_remove_pcoll))
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2281:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
File "/usr/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 671, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 654, in _read_inputs
for elements in elements_iterator:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
line 426, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:38229 {grpc_message:"Multiplexer hanging up", grpc_status:1,
created_time:"2022-09-04T03:46:29.817210809+00:00"}"
>
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47:
FutureWarning: Dropping of nuisance columns in DataFrame reductions (with
'numeric_only=None') is deprecated; in a future version this will raise
TypeError. Select only valid columns before calling the reduction.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664:
FutureWarning: WriteToFiles is experimental.
sink=lambda _: _WriteToPandasFileSink(
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml>
-
=========================== short test summary info ============================
FAILED
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
= 1 failed, 21 passed, 3 skipped, 6634 deselected, 40 warnings in 569.39s
(0:09:29) =
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 240
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 240
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 11s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/fb3yacz2qjcty
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
