See
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/4257/display/redirect?page=changes>
Changes:
[noreply] Port changes from Pub/Sub Lite to beam (#15418)
[heejong] [BEAM-12805] Fix XLang CombinePerKey test by explicitly assigning the
[BenWhitehead] [BEAM-8376] Google Cloud Firestore Connector - Add handling for
[noreply] Decreasing peak memory usage for beam.TupleCombineFn (#15494)
[noreply] [BEAM-12802] Add support for prefetch through data layers down through
[noreply] [BEAM-11097] Add implementation of side input cache (#15483)
------------------------------------------
[...truncated 18.66 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"PTRANSFORM": "ref_AppliedPTransform_assert_that-Match_22"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"urn": "beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"PTRANSFORM": "fn/read/ref_PCollection_PCollection_11:0"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"urn": "beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"PTRANSFORM": "ref_AppliedPTransform_assert_that-Group-RestoreTags_20"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"urn": "beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"PTRANSFORM": "ref_AppliedPTransform_assert_that-Unkey_21"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"urn": "beam:metric:element_count:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"payload": "AQ==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"PCOLLECTION": "ref_PCollection_PCollection_14"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"urn": "beam:metric:pardo_execution_time:process_bundle_msecs:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"PTRANSFORM": "fn/read/ref_PCollection_PCollection_11:0"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"urn": "beam:metric:ptransform_execution_time:total_msecs:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"PTRANSFORM": "ref_AppliedPTransform_assert_that-Match_22"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"urn": "beam:metric:pardo_execution_time:process_bundle_msecs:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"PTRANSFORM":
"ref_AppliedPTransform_assert_that-Group-CoGroupByKeyImpl-MapTuple-collect_values-_19"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"urn": "beam:metric:sampled_byte_size:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"type": "beam:metrics:distribution_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"payload": "AY4CjgKOAg==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"PCOLLECTION": "ref_PCollection_PCollection_11"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"urn": "beam:metric:sampled_byte_size:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"type": "beam:metrics:distribution_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"payload": "AYoCigKKAg==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"PCOLLECTION": "ref_PCollection_PCollection_12"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"urn": "beam:metric:sampled_byte_size:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"type": "beam:metrics:distribution_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"payload": "AQ4ODg==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"PCOLLECTION": "ref_PCollection_PCollection_15"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"urn": "beam:metric:sampled_byte_size:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"type": "beam:metrics:distribution_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"payload": "AYQChAKEAg==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"PCOLLECTION": "ref_PCollection_PCollection_13"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"urn": "beam:metric:sampled_byte_size:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"type": "beam:metrics:distribution_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"payload": "AfwB/AH8AQ==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'
"PCOLLECTION": "ref_PCollection_PCollection_14"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' }]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'}'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Free slot TaskSlot(index:11, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
5626dc984fc992e072d4bf21d19b7128, jobId: b4c8af96469e8fad52458f4277a384b4).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM
org.apache.flink.runtime.taskexecutor.TaskExecutor$JobLeaderListenerImpl
jobManagerLostLeadership'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
JobManager for job b4c8af96469e8fad52458f4277a384b4 with leader id
96e363c11e625122188fa09d3da34fb5 lost leadership.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Free slot TaskSlot(index:13, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
a2f0d9fbc1a8460cfd9a6dd99d06341f, jobId: b4c8af96469e8fad52458f4277a384b4).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Free slot TaskSlot(index:14, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
308d48c6ac365279e813effaaf6bf593, jobId: b4c8af96469e8fad52458f4277a384b4).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Free slot TaskSlot(index:15, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
a41ce073bee1773fac54813ad641458b, jobId: b4c8af96469e8fad52458f4277a384b4).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Free slot TaskSlot(index:4, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
e13e649599b887651d7ec653a78a7c89, jobId: b4c8af96469e8fad52458f4277a384b4).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Free slot TaskSlot(index:12, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
3d713db3225caf85f2e7570fdae95ca6, jobId: b4c8af96469e8fad52458f4277a384b4).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService
stop'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Stop job leader service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Shutting down TaskExecutorLocalStateStoresManager.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint
lambda$shutDownInternal$5'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Removing cache directory /tmp/flink-web-ui'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl
lambda$getFileCloser$0'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
FileChannelManager removed spill file directory
/tmp/flink-io-d896ba29-cf50-49d6-9c6e-33bdac566077'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.rest.RestServerEndpoint
lambda$closeAsync$1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Shut down complete.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.io.network.NettyShuffleEnvironment
close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Shutting down the network environment and its components.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl
lambda$getFileCloser$0'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
FileChannelManager removed spill file directory
/tmp/flink-netty-shuffle-4ccc085f-df69-47dd-bc1b-88e014e866ce'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.taskexecutor.KvStateService shutdown'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Shutting down the kvState service and its components.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService
stop'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Stop job leader service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.resourcemanager.ResourceManager
deregisterApplication'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Shut down cluster because application is in CANCELED, diagnostics
DispatcherResourceManagerComponent has been closed..'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM
org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent
closeAsyncInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Closing components.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.filecache.FileCache shutdown'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
removed file cache directory
/tmp/flink-dist-cache-30aa8466-6fa7-4056-820f-92fb6d965d43'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
handleOnStopException'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM
org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess
closeInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Stopping SessionDispatcherLeaderProcess.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.dispatcher.Dispatcher onStop'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Stopping dispatcher akka://flink/user/rpc/dispatcher_2.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.dispatcher.Dispatcher
terminateRunningJobs'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Stopping all currently running jobs of dispatcher
akka://flink/user/rpc/dispatcher_2.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Closing the slot manager.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
suspend'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Suspending the slot manager.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$0'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Stopped dispatcher akka://flink/user/rpc/dispatcher_2.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Stopping Akka RPC service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Stopping Akka RPC service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
lambda$stopService$7'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Stopped Akka RPC service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.blob.AbstractBlobCache close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Shutting down BLOB cache'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.blob.AbstractBlobCache close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Shutting down BLOB cache'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.blob.BlobServer close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Stopped BLOB server at 0.0.0.0:38555'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'Sep 11,
2021 12:32:34 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
lambda$stopService$7'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:576
Job state changed to DONE
INFO apache_beam.utils.subprocess_server:subprocess_server.py:122 b'INFO:
Stopped Akka RPC service.'
PASSED [100%]
=============================== warnings summary ===============================
apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_iobase_source
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_iobase_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1937:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_iobase_source
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_iobase_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1939:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_iobase_source
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_iobase_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1969:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
| _PassThroughThenCleanup(files_to_remove_pcoll))
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-flink-py37.xml>
-
============== 14 passed, 4 skipped, 6 warnings in 643.97 seconds ==============
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python3.7/threading.py", line 917, in _bootstrap_inner
self.run()
File "/usr/lib/python3.7/threading.py", line 865, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 659, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 642, in _read_inputs
for elements in elements_iterator:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
line 426, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string =
"{"created":"@1631319916.545286034","description":"Error received from peer
ipv4:127.0.0.1:45951","file":"src/core/lib/surface/call.cc","file_line":1069,"grpc_message":"Multiplexer
hanging up","grpc_status":1}"
>
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python3.7/threading.py", line 917, in _bootstrap_inner
self.run()
File "/usr/lib/python3.7/threading.py", line 865, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 659, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 642, in _read_inputs
for elements in elements_iterator:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
line 426, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string =
"{"created":"@1631320112.675690281","description":"Error received from peer
ipv4:127.0.0.1:35231","file":"src/core/lib/surface/call.cc","file_line":1069,"grpc_message":"Multiplexer
hanging up","grpc_status":1}"
>
> Task :sdks:python:test-suites:portable:py37:postCommitPy37
> Task :sdks:python:test-suites:dataflow:py37:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 120
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 39m 34s
214 actionable tasks: 195 executed, 15 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/4syl7ng4c2srq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
