See
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/4636/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13438][Playground]
[stranniknm] [BEAM-13446]: fix incorrect tab symbol
[noreply] [BEAM-13159] Add Redis Stream (XADD) Write Support (#15858)
[noreply] Merge pull request #15994: [BEAM-13263] Support OnWindowExpiration in
[noreply] Bump dataflow container version to beam-master-20211213 (#16213)
[noreply] Merge pull request #16198 from [BEAM-13437][Playground] Add
[noreply] Merge pull request #16195 from a[BEAM-13436][Playground] Add
------------------------------------------
[...truncated 45.62 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [4df19ffc8664b9cf4ae122e9bc3c1272].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [a9300f297356667f90502a038cfe88db].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [7a797738ed8116dd5aab3b27bc25edb3].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [3f09d82fffa8df2414bc238ed1568da4].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [823f80711689ba1707dfffa9b90f9122].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [460b6b89658a57c35a016807a2f5ffd4].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [1c3b44d1a3ceb0fac919dfc1dcc36468].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [49dc243989f8d1bcf2f9bfa626c233f2].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [b69f4aa6cc5793ae4311a68bd15506ff].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [8b9c2df131b69f39dcd5360b9148f145].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [2ea66d4585342f297ecc93a9dab7b7bf].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [dc7672ab83159c610b6a4a2ceed943a2].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [99afa60fe2009ce89fda92875e7543d8].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [d6b1d3a9821dd64854a6f8c8b9cd9d75].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [ca6d94231158e7091a0aecc2d589bea2].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [bf553e0d3ab42264bac008935a44adc0].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
processResourceRequirements'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Clearing resource requirements of job fb1ed22b4432f93828c3d3c5bedd859d'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM org.apache.flink.runtime.jobmaster.JobMaster
dissolveResourceManagerConnection'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Close ResourceManager connection c011cbb309886822a237d8df43353b7a: Stopping
JobMaster for job
BeamApp-jenkins-1214183617-2f7b9ede(fb1ed22b4432f93828c3d3c5bedd859d)..'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:22 PM org.apache.flink.runtime.resourcemanager.ResourceManager
closeJobManagerConnection'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Disconnect job manager
8452c52ec8af076817c9973d4eed42cc@akka://flink/user/rpc/jobmanager_3 for job
fb1ed22b4432f93828c3d3c5bedd859d from the resource manager.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:1, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
7a797738ed8116dd5aab3b27bc25edb3, jobId: fb1ed22b4432f93828c3d3c5bedd859d).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:12, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
3f09d82fffa8df2414bc238ed1568da4, jobId: fb1ed22b4432f93828c3d3c5bedd859d).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM
org.apache.flink.runtime.taskexecutor.TaskExecutor$JobLeaderListenerImpl
jobManagerLostLeadership'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
JobManager for job fb1ed22b4432f93828c3d3c5bedd859d with leader id
8452c52ec8af076817c9973d4eed42cc lost leadership.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:3, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
823f80711689ba1707dfffa9b90f9122, jobId: fb1ed22b4432f93828c3d3c5bedd859d).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:14, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
460b6b89658a57c35a016807a2f5ffd4, jobId: fb1ed22b4432f93828c3d3c5bedd859d).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:2, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
1c3b44d1a3ceb0fac919dfc1dcc36468, jobId: fb1ed22b4432f93828c3d3c5bedd859d).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:7, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
49dc243989f8d1bcf2f9bfa626c233f2, jobId: fb1ed22b4432f93828c3d3c5bedd859d).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:13, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
b69f4aa6cc5793ae4311a68bd15506ff, jobId: fb1ed22b4432f93828c3d3c5bedd859d).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:4, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
8b9c2df131b69f39dcd5360b9148f145, jobId: fb1ed22b4432f93828c3d3c5bedd859d).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint
lambda$shutDownInternal$5'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Removing cache directory /tmp/flink-web-ui'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:8, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
2ea66d4585342f297ecc93a9dab7b7bf, jobId: fb1ed22b4432f93828c3d3c5bedd859d).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:15, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
dc7672ab83159c610b6a4a2ceed943a2, jobId: fb1ed22b4432f93828c3d3c5bedd859d).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.rest.RestServerEndpoint
lambda$closeAsync$1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shut down complete.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:11, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
99afa60fe2009ce89fda92875e7543d8, jobId: fb1ed22b4432f93828c3d3c5bedd859d).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:9, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
d6b1d3a9821dd64854a6f8c8b9cd9d75, jobId: fb1ed22b4432f93828c3d3c5bedd859d).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.resourcemanager.ResourceManager
deregisterApplication'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shut down cluster because application is in CANCELED, diagnostics
DispatcherResourceManagerComponent has been closed..'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM
org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent
closeAsyncInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Closing components.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:6, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
ca6d94231158e7091a0aecc2d589bea2, jobId: fb1ed22b4432f93828c3d3c5bedd859d).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM
org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess
closeInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping SessionDispatcherLeaderProcess.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.dispatcher.Dispatcher onStop'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping dispatcher akka://flink/user/rpc/dispatcher_2.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.dispatcher.Dispatcher
terminateRunningJobs'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping all currently running jobs of dispatcher
akka://flink/user/rpc/dispatcher_2.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Closing the slot manager.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
suspend'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Suspending the slot manager.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:5, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
bf553e0d3ab42264bac008935a44adc0, jobId: fb1ed22b4432f93828c3d3c5bedd859d).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$0'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped dispatcher akka://flink/user/rpc/dispatcher_2.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService
stop'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stop job leader service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shutting down TaskExecutorLocalStateStoresManager.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl
lambda$getFileCloser$0'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
FileChannelManager removed spill file directory
/tmp/flink-io-fa10cf1b-7636-46cf-ab93-307289d38d50'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.io.network.NettyShuffleEnvironment
close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shutting down the network environment and its components.'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:576
Job state changed to DONE
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl
lambda$getFileCloser$0'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
FileChannelManager removed spill file directory
/tmp/flink-netty-shuffle-9599cee9-2743-4838-a9a3-ea077f315989'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.taskexecutor.KvStateService shutdown'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shutting down the kvState service and its components.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService
stop'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stop job leader service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.filecache.FileCache shutdown'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
removed file cache directory
/tmp/flink-dist-cache-e1365b64-5bbe-4c46-a06f-f0786835c57e'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.taskexecutor.TaskExecutor
handleOnStopException'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping Akka RPC service.'
PASSED [100%]
------------------------------ live log teardown -------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping Akka RPC service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService
lambda$stopService$7'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped Akka RPC service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.blob.AbstractBlobCache close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shutting down BLOB cache'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.blob.AbstractBlobCache close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shutting down BLOB cache'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.blob.BlobServer close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped BLOB server at 0.0.0.0:42463'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 14,
2021 6:37:23 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService
lambda$stopService$7'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped Akka RPC service.'
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-flink-py37.xml>
-
========================== 7 passed in 515.20 seconds ==========================
> Task :sdks:python:test-suites:dataflow:py37:postCommitIT FAILED
> Task :sdks:python:test-suites:dataflow:py37:spannerioIT
>>> RUNNING integration tests with pipeline options:
>>> --runner=TestDataflowRunner --project=apache-beam-testing
>>> --region=us-central1
>>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it
>>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it
>>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
>>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/build/apache-beam.tar.gz>
>>> --requirements_file=postcommit_requirements.txt --num_workers=1
>>> --sleep_secs=20
>>> --dataflow_worker_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.36.0-SNAPSHOT.jar>
>>>
>>> --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>
>>> --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes
>>> --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=spannerio_it
[1m============================= test session starts
==============================[0m
platform linux -- Python 3.7.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir:
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python,>
inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw0] Python 3.7.10 (default, Feb 20 2021, 21:21:24) -- [GCC 5.4.0
20160609]
[0m[1m[gw2] Python 3.7.10 (default, Feb 20 2021, 21:21:24) -- [GCC 5.4.0
20160609]
[0m[1m[gw1] Python 3.7.10 (default, Feb 20 2021, 21:21:24) -- [GCC 5.4.0
20160609]
[0m[1m[gw4] Python 3.7.10 (default, Feb 20 2021, 21:21:24) -- [GCC 5.4.0
20160609]
[0m[1m[gw3] Python 3.7.10 (default, Feb 20 2021, 21:21:24) -- [GCC 5.4.0
20160609]
[0m[1m[gw5] Python 3.7.10 (default, Feb 20 2021, 21:21:24) -- [GCC 5.4.0
20160609]
[0m[1m[gw7] Python 3.7.10 (default, Feb 20 2021, 21:21:24) -- [GCC 5.4.0
20160609]
[0m[1m[gw6] Python 3.7.10 (default, Feb 20 2021, 21:21:24) -- [GCC 5.4.0
20160609]
[0mgw0 [15] / gw1 [15] / gw2 [15] / gw3 [15] / gw4 [15] / gw5 [15] / gw6 [15]
/ gw7 [15]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_error_call
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql
[gw2] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_error_call
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_ok_call
[gw2] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_ok_call
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error
[gw2] [32mPASSED[0m
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update
[gw0] [32mPASSED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table
[gw2] [32mPASSED[0m
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches
[gw0] [32mPASSED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_error_call
[gw0] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_error_call
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_ok_call
[gw0] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_ok_call
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call
[gw0] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_ok_call
[gw0] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_ok_call
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_error_call
[gw0] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_error_call
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_ok_call
[gw0] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_ok_call
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_error_call
[gw0] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_error_call
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_ok_call
[gw0] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_ok_call
[gw2] [32mPASSED[0m
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches
[33m=============================== warnings summary
===============================[0m
apache_beam/io/gcp/experimental/spannerio_write_it_test.py:190
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:190:
FutureWarning: WriteToSpanner is experimental. No backwards-compatibility
guarantees.
database_id=self.TEST_DATABASE))
apache_beam/io/gcp/experimental/spannerio_read_it_test.py:128
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:128:
FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility
guarantees.
sql="select * from Users")
apache_beam/io/gcp/experimental/spannerio_write_it_test.py:171
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:171:
FutureWarning: WriteToSpanner is experimental. No backwards-compatibility
guarantees.
database_id=self.TEST_DATABASE))
apache_beam/io/gcp/experimental/spannerio_read_it_test.py:117
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:117:
FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility
guarantees.
columns=["UserId", "Key"])
apache_beam/io/gcp/experimental/spannerio_write_it_test.py:135
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:135:
FutureWarning: WriteToSpanner is experimental. No backwards-compatibility
guarantees.
max_batch_size_bytes=250))
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-df-py37.xml>
-
[33m[1m============= 5 passed, 10 skipped, 5 warnings in 1734.81 seconds
==============[0m
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 120
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 50m 17s
217 actionable tasks: 162 executed, 51 from cache, 4 up-to-date
Publishing build scan...
Publishing build scan failed due to network error
'java.net.SocketTimeoutException: Read timed out' (2 retries remaining)...
Publishing build scan failed due to network error
'java.net.SocketTimeoutException: Read timed out' (1 retry remaining)...
A network error occurred.
If you require assistance with this problem, please report it via
https://gradle.com/help/plugin and include the following information via
copy/paste.
----------
Gradle version: 6.9.1
Plugin version: 3.4.1
Request URL: https://scans-in.gradle.com/scans/publish/gradle/3.4.1/token
Request ID: 68c28eba-68b2-4eea-919a-7a62c9cab7ee
Exception: java.net.SocketTimeoutException: Read timed out
----------
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
