See 
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1094/display/redirect?page=changes>

Changes:

[noreply] Update release notes. (#23986)

[noreply] [Go] Pipeline Resource Hints (#23990)

[noreply] [#21250] Trivial removal of loop over something that always has one

[noreply] Bump cloud.google.com/go/bigtable from 1.16.0 to 1.17.0 in /sdks

[noreply] Editorial review of the ML base API descriptions (#24026)

[noreply] Update my Twitter handle (#23653)

[noreply] Retroactively announce Batched DoFn support in 2.42.0 Blog (#24011)

[noreply] Bump cloud.google.com/go/storage from 1.27.0 to 1.28.0 in /sdks 
(#24028)


------------------------------------------
[...truncated 181.07 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   at 
akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   at 
akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   at 
akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   at 
akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   at 
akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   at 
akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   ... 4 
more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused 
by: java.io.IOException: Insufficient number of network buffers: required 16, 
but only 8 available. The total number of network buffers is currently set to 
2048 of 32768 bytes each. You can increase this number by setting the 
configuration keys 'taskmanager.memory.network.fraction', 
'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   at 
org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   at 
org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   at 
org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   at 
org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   at 
org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   at 
org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   at 
org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   at 
org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   at 
java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService 
stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM org.apache.flink.runtime.jobmaster.JobMaster 
dissolveResourceManagerConnection
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Close ResourceManager connection a7eee25054d578ae6df1a9960c37b54e: Stopping 
JobMaster for job 'BeamApp-jenkins-1108215207-be1d338b' 
(293709d4f49dd3d142d9a33d8fec6f17).
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM 
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Shutting down TaskExecutorLocalStateStoresManager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM org.apache.flink.runtime.resourcemanager.ResourceManager 
closeJobManagerConnection
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Disconnect job manager 
aaa19753b9626033cb0f1aa75f174b05@akka://flink/user/rpc/jobmanager_3 for job 
293709d4f49dd3d142d9a33d8fec6f17 from the resource manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint 
lambda$shutDownInternal$5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Removing cache directory /tmp/flink-web-ui
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM org.apache.flink.runtime.rest.RestServerEndpoint 
lambda$closeAsync$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Shut down complete.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM org.apache.flink.runtime.resourcemanager.ResourceManager 
deregisterApplication
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Shut down cluster because application is in CANCELED, diagnostics 
DispatcherResourceManagerComponent has been closed..
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl 
lambda$getFileCloser$0
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number 
of network buffers: required 16, but only 8 available. The total number of 
network buffers is currently set to 2048 of 32768 bytes each. You can increase 
this number by setting the configuration keys 
'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 
'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
FileChannelManager removed spill file directory 
/tmp/flink-io-0ee4cb31-6055-4b41-b761-607ec9548043
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM org.apache.flink.runtime.io.network.NettyShuffleEnvironment 
close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Shutting down the network environment and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM 
org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent
 closeAsyncInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Closing components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM 
org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess 
closeInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Stopping SessionDispatcherLeaderProcess.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM 
org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl closeAsync
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Stopping resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM org.apache.flink.runtime.dispatcher.Dispatcher 
terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Stopping all currently running jobs of dispatcher 
akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl 
lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
FileChannelManager removed spill file directory 
/tmp/flink-netty-shuffle-f409aa0a-41b5-42d1-842e-ca05317375a5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM 
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager 
close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM 
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager 
suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService 
stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
removed file cache directory 
/tmp/flink-dist-cache-47114b51-c474-4ebd-b399-5c77014f82dd
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM org.apache.flink.runtime.taskexecutor.TaskExecutor 
handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 
2022 9:52:16 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 
Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 
Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15:
 DeprecationWarning: the imp module is deprecated in favour of importlib; see 
the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63:
 PendingDeprecationWarning: Client.dataset is deprecated and will be removed in 
a future version. Use a string like 'my_project.my_dataset' or a 
cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100:
 PendingDeprecationWarning: Client.dataset is deprecated and will be removed in 
a future version. Use a string like 'my_project.my_dataset' or a 
cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47:
 FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 
'numeric_only=None') is deprecated; in a future version this will raise 
TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664:
 FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
- generated xml file: 
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml>
 -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - 
RuntimeError: Pipeline 
BeamApp-jenkins-1108214536-cab6136f_5ab1d460-20d0-457a-8588-684412033516 failed 
in state FAILED: java.io.IOException: Insufficient number of network buffers: 
required 16, but only 3 available. The total number of network buffers is 
currently set to 2048 of 32768 bytes each. You can increase this number by 
setting the configuration keys 'taskmanager.memory.network.fraction', 
'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED 
apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
 - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
 line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
 line 654, in _read_inputs
    for elements in elements_iterator:
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
 line 426, in __next__
    return self._next()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
 line 826, in _next
    raise self
FAILED 
apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo
 - RuntimeError: Pipeline 
BeamApp-jenkins-1108215207-be1d338b_c68fabe2-0019-4abc-93c8-cdf47272ab95 failed 
in state FAILED: java.io.IOException: Insufficient number of network buffers: 
required 16, but only 8 available. The total number of network buffers is 
currently set to 2048 of 32768 bytes each. You can increase this number by 
setting the configuration keys 'taskmanager.memory.network.fraction', 
'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 41 warnings in 661.46s 
(0:11:01) =
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that 
terminated with:
        status = StatusCode.CANCELLED
        details = "Multiplexer hanging up"
        debug_error_string = "UNKNOWN:Error received from peer 
ipv6:%5B::1%5D:42345 {grpc_message:"Multiplexer hanging up", grpc_status:1, 
created_time:"2022-11-08T21:51:57.65228488+00:00"}"
>

Exception in thread run_worker_1-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py";,>
 line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
 line 426, in __next__
    return self._next()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
 line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that 
terminated with:
        status = StatusCode.UNAVAILABLE
        details = "Socket closed"
        debug_error_string = "UNKNOWN:Error received from peer 
ipv6:%5B::1%5D:33291 {grpc_message:"Socket closed", grpc_status:14, 
created_time:"2022-11-08T21:53:41.470811642+00:00"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script 
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
 line: 240

* What went wrong:
Execution failed for task 
':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script 
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
 line: 240

* What went wrong:
Execution failed for task 
':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings 
and determine if they come from your own scripts or plugins.

See 
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 15m 28s
133 actionable tasks: 89 executed, 42 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/sgyf5xiuk2lbg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to