See
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/786/display/redirect?page=changes>
Changes:
[Kiley Sok] Update Beam 2.41.0 release docs
[noreply] [Playground] Setup Datastore in Playground project using Terraform -
[noreply] Add bag state support (#22816)
------------------------------------------
[...truncated 109.04 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying GroupReduce (GroupReduce at WriteToText/Write/WriteImpl/GroupByKey)
(14/16) (attempt #0) with attempt id e01c89826f09b77e9b59ae981074824c and
vertex id 091c3edecd5f9d66fe96ea9924ba3e1f_13 to
7d6cb860-0b0a-4a48-8e54-572648c9f144 @ localhost (dataPort=-1) with allocation
id 74873d08965f2bcaa44d21704a653df1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 23,
2022 9:44:07 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
GroupReduce (GroupReduce at WriteToText/Write/WriteImpl/GroupByKey) (15/16)
(01e7024c4e83efc28f6f82948b74c90e) switched from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 23,
2022 9:44:07 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
MapPartition (MapPartition at [2]read_words/{Read, _PassThroughThenCleanup})
(4/16)#0 (fa5534864afd24e72545439f9ada939b) switched from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 23,
2022 9:44:07 PM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying GroupReduce (GroupReduce at WriteToText/Write/WriteImpl/GroupByKey)
(15/16) (attempt #0) with attempt id 01e7024c4e83efc28f6f82948b74c90e and
vertex id 091c3edecd5f9d66fe96ea9924ba3e1f_14 to
7d6cb860-0b0a-4a48-8e54-572648c9f144 @ localhost (dataPort=-1) with allocation
id e56cf7c513d2ce2ade962b45b4ec1483
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 23,
2022 9:44:07 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Loading JAR files for task MapPartition (MapPartition at [2]read_words/{Read,
_PassThroughThenCleanup}) (4/16)#0 (fa5534864afd24e72545439f9ada939b)
[DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 23,
2022 9:44:07 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
GroupReduce (GroupReduce at WriteToText/Write/WriteImpl/GroupByKey) (16/16)
(29bbdda39b497c812ef5e26fa53c2deb) switched from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 23,
2022 9:44:07 PM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying GroupReduce (GroupReduce at WriteToText/Write/WriteImpl/GroupByKey)
(16/16) (attempt #0) with attempt id 29bbdda39b497c812ef5e26fa53c2deb and
vertex id 091c3edecd5f9d66fe96ea9924ba3e1f_15 to
7d6cb860-0b0a-4a48-8e54-572648c9f144 @ localhost (dataPort=-1) with allocation
id 6dbc8ae281a8172390094cac39eeaa31
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 23,
2022 9:44:07 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]WriteToText/Write/WriteImpl/Extract) ->
FlatMap (FlatMap at ExtractOutput[0]) (1/16) (e9d30966dc16e66bbbd97ff568093d37)
switched from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 23,
2022 9:44:07 PM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Received task MapPartition (MapPartition at [2]read_words/{Read,
_PassThroughThenCleanup}) (5/16)#0 (01e86c269670c4dd983153898d7f9e62), deploy
into slot with allocation id 1d5cff7f56ad59163258bce767f0e908.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 23,
2022 9:44:07 PM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying CHAIN MapPartition (MapPartition at
[1]WriteToText/Write/WriteImpl/Extract) -> FlatMap (FlatMap at
ExtractOutput[0]) (1/16) (attempt #0) with attempt id
e9d30966dc16e66bbbd97ff568093d37 and vertex id
0550cf0290686a6ecf2de1bc093cb2c0_0 to 7d6cb860-0b0a-4a48-8e54-572648c9f144 @
localhost (dataPort=-1) with allocation id b6c8c385235de4fc3ec6d62e9cbe4a11
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 23,
2022 9:44:07 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
MapPartition (MapPartition at [2]read_words/{Read, _PassThroughThenCleanup})
(5/16)#0 (01e86c269670c4dd983153898d7f9e62) switched from CREATED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 23,
2022 9:44:07 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
markExistingSlotActive
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Activate slot d7e5cf032ab3aed2451b5e50e28e2a35.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 23,
2022 9:44:07 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]WriteToText/Write/WriteImpl/Extract) ->
FlatMap (FlatMap at ExtractOutput[0]) (2/16) (040105bcc68e822c968e08ba6a0ad42e)
switched from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 23,
2022 9:44:07 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Loading JAR files for task MapPartition (MapPartition at [2]read_words/{Read,
_PassThroughThenCleanup}) (5/16)#0 (01e86c269670c4dd983153898d7f9e62)
[DEPLOYING].
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 23,
2022 9:44:07 PM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying CHAIN MapPartition (MapPartition at
[1]WriteToText/Write/WriteImpl/Extract) -> FlatMap (FlatMap at
ExtractOutput[0]) (2/16) (attempt #0) with attempt id
040105bcc68e822c968e08ba6a0ad42e and vertex id
0550cf0290686a6ecf2de1bc093cb2c0_1 to 7d6cb860-0b0a-4a48-8e54-572648c9f144 @
localhost (dataPort=-1) with allocation id 04455f888edf125d6073b5a3cb8fb085
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 23,
2022 9:44:07 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]WriteToText/Write/WriteImpl/Extract) ->
FlatMap (FlatMap at ExtractOutput[0]) (3/16) (d4a555a13184f0996bbf743dcf42be4c)
switched from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 23,
2022 9:44:07 PM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying CHAIN MapPartition (MapPartition at
[1]WriteToText/Write/WriteImpl/Extract) -> FlatMap (FlatMap at
ExtractOutput[0]) (3/16) (attempt #0) with attempt id
d4a555a13184f0996bbf743dcf42be4c and vertex id
0550cf0290686a6ecf2de1bc093cb2c0_2 to 7d6cb860-0b0a-4a48-8e54-572648c9f144 @
localhost (dataPort=-1) with allocation id b329250b634ff5be98b806ceeee6dd63
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 23,
2022 9:44:07 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
CHAIN MapPartition (MapPartition at [1]WriteToText/Write/WriteImpl/Extract) ->
FlatMap (FlatMap at ExtractOutput[0]) (4/16) (9af0f39fc498ee253347904d986453db)
switched from SCHEDULED to DEPLOYING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 23,
2022 9:44:07 PM org.apache.flink.runtime.executiongraph.Execution deploy
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Deploying CHAIN MapPartition (MapPartition at
[1]WriteToText/Write/WriteImpl/Extract) -> FlatMap (FlatMap at
ExtractOutput[0]) (4/16) (attempt #0) with attempt id
9af0f39fc498ee253347904d986453db and vertex id
0550cf0290686a6ecf2de1bc093cb2c0_3 to 7d6cb860-0b0a-4a48-8e54-572648c9f144 @
localhost (dataPort=-1) with allocation id 087707eb8354d3597b115408dfdfa8e7
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2285:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2291:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1129:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1131:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2774:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",>
line 284, in _execute
response = task()
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",>
line 357, in <lambda>
lambda: self.create_worker().do_instruction(request), request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",>
line 598, in do_instruction
getattr(request, request_type), request.instruction_id)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",>
line 629, in process_bundle
instruction_id, request.process_bundle_descriptor_id)
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2776:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",>
line 459, in get
self.fns[bundle_descriptor_id],
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",>
line 1377, in __missing__
self[key] = self.default_factory(key) # type: ignore # pylint:
disable=E1137
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",>
line 203, in default_factory
process_bundle_descriptor_id=id))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_interceptor.py",>
line 221, in __call__
compression=compression)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_interceptor.py",>
line 257, in _with_call
return call.result(), call
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",>
line 343, in result
raise self
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_interceptor.py",>
line 247, in continuation
compression=new_compression)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",>
line 957, in with_call
return _end_unary_response_blocking(state, call, True, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",>
line 849, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "failed to connect to all addresses"
debug_error_string =
"{"created":"@1661291049.408524297","description":"Failed to pick
subchannel","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":3260,"referenced_errors":[{"created":"@1661291049.408522544","description":"failed
to connect to all
addresses","file":"src/core/lib/transport/error_utils.cc","file_line":167,"grpc_status":14}]}"
>
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2807:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
| _PassThroughThenCleanup(files_to_remove_pcoll))
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
Exception in thread read_grpc_client_inputs:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2281:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
Traceback (most recent call last):
File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/usr/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",>
line 671, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",>
line 654, in _read_inputs
for elements in elements_iterator:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",>
line 426, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",>
line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string =
"{"created":"@1661291085.710604312","description":"Error received from peer
ipv6:[::1]:44721","file":"src/core/lib/surface/call.cc","file_line":966,"grpc_message":"Multiplexer
hanging up","grpc_status":1}"
>
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/usr/lib/python3.7/threading.py", line 870, in run
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47:
FutureWarning: Dropping of nuisance columns in DataFrame reductions (with
'numeric_only=None') is deprecated; in a future version this will raise
TypeError. Select only valid columns before calling the reduction.
return airline_df[at_top_airports].mean()
self._target(*self._args, **self._kwargs)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:632:
FutureWarning: WriteToFiles is experimental.
sink=lambda _: _WriteToPandasFileSink( File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",>
line 671, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",>
line 654, in _read_inputs
for elements in elements_iterator:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",>
line 426, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",>
line 826, in _next
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:581:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml>
-
=========================== short test summary info ============================
FAILED
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
= 1 failed, 21 passed, 3 skipped, 6528 deselected, 39 warnings in 516.49s
(0:08:36) =
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string =
"{"created":"@1661291153.406393885","description":"Error received from peer
ipv6:[::1]:42245","file":"src/core/lib/surface/call.cc","file_line":966,"grpc_message":"Multiplexer
hanging up","grpc_status":1}"
>
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 240
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 240
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 17s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xauwdzjxyfsvm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]