See
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/4661/display/redirect?page=changes>
Changes:
[stranniknm] [BEAM-13466]: sort categories and examples by name
[noreply] [BEAM-13399] Add check for dev versions of JARs to download code
[noreply] Merge pull request #16122 from [BEAM-13345] [Playground] add resizable
[noreply] Merge pull request #16170 from [BEAM-13411][Playground] Add getting of
[noreply] Merge pull request #16172 from [BEAM-13417] [Playground] Add java
[noreply] Merge pull request #16240 from [BEAM-13465][Playground] Change error
[noreply] Merge pull request #16234 from [BEAM-13461][Playground] [Bugfix] Error
[noreply] Merge pull request #15489 from [BEAM-12865] Allow custom
batch_duration
[noreply] [BEAM-13483] Increase timeout of Java Examples Dataflow suite.
(#16226)
[noreply] Pin transitive log4j dependencies to 2.17.0 in :sdks:java:io:hcatalog
------------------------------------------
[...truncated 25.13 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [13526028be99812730f7e02123274f3a].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:16 AM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [c1ee888afa3171db58b322b86e1e43eb].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:16 AM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [baf5355157fc75ad129ad07a77657ec4].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:16 AM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [f6bffa87c3780a6bcdf20bdb3097afe0].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:16 AM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [99c0b4e795835b158815da5fe0fccf71].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:16 AM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [b5b59fcfa7859d5b53130f1363de54ad].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:16 AM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [8bf9a3bd0bb8be37550aecda108803ea].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:16 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:4, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
9188a4e0d5ddcc8b1270f3436e68aacf, jobId: 87b236a2a1fc941891f83ce4794ee8ca).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:16 AM
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool
releaseSlots'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Releasing slot [3fb1f8ea6884c9812bfe226e4f944c06].'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:16 AM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
processResourceRequirements'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Clearing resource requirements of job 87b236a2a1fc941891f83ce4794ee8ca'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:16 AM org.apache.flink.runtime.jobmaster.JobMaster
dissolveResourceManagerConnection'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Close ResourceManager connection aa0a5d8112778611bd7194b32b1d6c8e: Stopping
JobMaster for job
BeamApp-jenkins-1221002319-1ed2c9db(87b236a2a1fc941891f83ce4794ee8ca)..'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:16 AM org.apache.flink.runtime.resourcemanager.ResourceManager
closeJobManagerConnection'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Disconnect job manager
a21f354993b7875e8c37c8a0088a492f@akka://flink/user/rpc/jobmanager_3 for job
87b236a2a1fc941891f83ce4794ee8ca from the resource manager.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:9, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
ce52d995832d2b16da01607961c3694b, jobId: 87b236a2a1fc941891f83ce4794ee8ca).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:2, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
58d974ee4e9c8f83cdedc30492c89ae7, jobId: 87b236a2a1fc941891f83ce4794ee8ca).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:0, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
13526028be99812730f7e02123274f3a, jobId: 87b236a2a1fc941891f83ce4794ee8ca).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:5, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
c1ee888afa3171db58b322b86e1e43eb, jobId: 87b236a2a1fc941891f83ce4794ee8ca).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:7, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
baf5355157fc75ad129ad07a77657ec4, jobId: 87b236a2a1fc941891f83ce4794ee8ca).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:15, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
f6bffa87c3780a6bcdf20bdb3097afe0, jobId: 87b236a2a1fc941891f83ce4794ee8ca).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:1, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
99c0b4e795835b158815da5fe0fccf71, jobId: 87b236a2a1fc941891f83ce4794ee8ca).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:13, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
b5b59fcfa7859d5b53130f1363de54ad, jobId: 87b236a2a1fc941891f83ce4794ee8ca).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM
org.apache.flink.runtime.taskexecutor.TaskExecutor$JobLeaderListenerImpl
jobManagerLostLeadership'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
JobManager for job 87b236a2a1fc941891f83ce4794ee8ca with leader id
a21f354993b7875e8c37c8a0088a492f lost leadership.'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:576
Job state changed to DONE
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:14, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
8bf9a3bd0bb8be37550aecda108803ea, jobId: 87b236a2a1fc941891f83ce4794ee8ca).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl
freeSlotInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Free slot TaskSlot(index:10, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
3fb1f8ea6884c9812bfe226e4f944c06, jobId: 87b236a2a1fc941891f83ce4794ee8ca).'
PASSED [100%]
------------------------------ live log teardown -------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint
lambda$shutDownInternal$5'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Removing cache directory /tmp/flink-web-ui'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.rest.RestServerEndpoint
lambda$closeAsync$1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shut down complete.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService
stop'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stop job leader service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shutting down TaskExecutorLocalStateStoresManager.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.resourcemanager.ResourceManager
deregisterApplication'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shut down cluster because application is in CANCELED, diagnostics
DispatcherResourceManagerComponent has been closed..'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM
org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent
closeAsyncInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Closing components.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM
org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess
closeInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping SessionDispatcherLeaderProcess.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.dispatcher.Dispatcher onStop'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping dispatcher akka://flink/user/rpc/dispatcher_2.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.dispatcher.Dispatcher
terminateRunningJobs'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping all currently running jobs of dispatcher
akka://flink/user/rpc/dispatcher_2.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$0'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped dispatcher akka://flink/user/rpc/dispatcher_2.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Closing the slot manager.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
suspend'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Suspending the slot manager.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl
lambda$getFileCloser$0'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
FileChannelManager removed spill file directory
/tmp/flink-io-f028c892-0bd9-4134-bf62-68b70f8bf440'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.io.network.NettyShuffleEnvironment
close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shutting down the network environment and its components.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl
lambda$getFileCloser$0'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
FileChannelManager removed spill file directory
/tmp/flink-netty-shuffle-bc9e945c-0b97-4efc-b485-dcb8169f2849'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.taskexecutor.KvStateService shutdown'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shutting down the kvState service and its components.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService
stop'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stop job leader service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.filecache.FileCache shutdown'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
removed file cache directory
/tmp/flink-dist-cache-34a293ee-b27a-4729-b0c3-7d003a37709e'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
handleOnStopException'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping Akka RPC service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping Akka RPC service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
lambda$stopService$7'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped Akka RPC service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.blob.AbstractBlobCache close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shutting down BLOB cache'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.blob.AbstractBlobCache close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shutting down BLOB cache'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.blob.BlobServer close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped BLOB server at 0.0.0.0:42991'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Dec 21,
2021 12:24:17 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
lambda$stopService$7'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped Akka RPC service.'
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-flink-py37.xml>
-
========================== 7 passed in 565.65 seconds ==========================
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/usr/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 651, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 634, in _read_inputs
for elements in elements_iterator:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
line 426, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,>
line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string =
"{"created":"@1640045767.722126618","description":"Error received from peer
ipv4:127.0.0.1:39135","file":"src/core/lib/surface/call.cc","file_line":1074,"grpc_message":"Multiplexer
hanging up","grpc_status":1}"
>
> Task :sdks:python:test-suites:dataflow:py37:postCommitIT FAILED
> Task :sdks:python:test-suites:dataflow:py37:spannerioIT
>>> RUNNING integration tests with pipeline options:
>>> --runner=TestDataflowRunner --project=apache-beam-testing
>>> --region=us-central1
>>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it
>>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it
>>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
>>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/build/apache-beam.tar.gz>
>>> --requirements_file=postcommit_requirements.txt --num_workers=1
>>> --sleep_secs=20
>>> --dataflow_worker_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.36.0-SNAPSHOT.jar>
>>>
>>> --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>
>>> --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --timeout=4500 --color=yes
>>> --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>> collect markers: -m=spannerio_it
[1m============================= test session starts
==============================[0m
platform linux -- Python 3.7.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir:
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python,>
inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[1m[gw1] Python 3.7.10 (default, Feb 20 2021, 21:21:24) -- [GCC 5.4.0
20160609]
[0m[1m[gw0] Python 3.7.10 (default, Feb 20 2021, 21:21:24) -- [GCC 5.4.0
20160609]
[0m[1m[gw2] Python 3.7.10 (default, Feb 20 2021, 21:21:24) -- [GCC 5.4.0
20160609]
[0m[1m[gw4] Python 3.7.10 (default, Feb 20 2021, 21:21:24) -- [GCC 5.4.0
20160609]
[0m[1m[gw5] Python 3.7.10 (default, Feb 20 2021, 21:21:24) -- [GCC 5.4.0
20160609]
[0m[1m[gw3] Python 3.7.10 (default, Feb 20 2021, 21:21:24) -- [GCC 5.4.0
20160609]
[0m[1m[gw6] Python 3.7.10 (default, Feb 20 2021, 21:21:24) -- [GCC 5.4.0
20160609]
[0m[1m[gw7] Python 3.7.10 (default, Feb 20 2021, 21:21:24) -- [GCC 5.4.0
20160609]
[0mgw0 [15] / gw1 [15] / gw2 [15] / gw3 [15] / gw4 [15] / gw5 [15] / gw6 [15]
/ gw7 [15]
scheduling tests via LoadFileScheduling
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_error_call
[gw0] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_error_call
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_ok_call
[gw0] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_metrics_ok_call
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error
[gw1] [32mPASSED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_sql
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table
[gw0] [32mPASSED[0m
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_error
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update
[gw1] [32mPASSED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_read_via_table
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_error_call
[gw1] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_error_call
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_ok_call
[gw1] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_sql_metrics_ok_call
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call
[gw1] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_ok_call
[gw1] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_ok_call
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_error_call
[gw1] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_error_call
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_ok_call
[gw1] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_sql_metrics_ok_call
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_error_call
[gw1] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_error_call
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_ok_call
[gw1] [33mSKIPPED[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_transaction_table_metrics_ok_call
[gw0] [32mPASSED[0m
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_spanner_update
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches
[gw0] [32mPASSED[0m
apache_beam/io/gcp/experimental/spannerio_write_it_test.py::SpannerWriteIntegrationTest::test_write_batches
[33m=============================== warnings summary
===============================[0m
apache_beam/io/gcp/experimental/spannerio_read_it_test.py:128
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:128:
FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility
guarantees.
sql="select * from Users")
apache_beam/io/gcp/experimental/spannerio_write_it_test.py:190
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:190:
FutureWarning: WriteToSpanner is experimental. No backwards-compatibility
guarantees.
database_id=self.TEST_DATABASE))
apache_beam/io/gcp/experimental/spannerio_read_it_test.py:117
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:117:
FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility
guarantees.
columns=["UserId", "Key"])
apache_beam/io/gcp/experimental/spannerio_write_it_test.py:171
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:171:
FutureWarning: WriteToSpanner is experimental. No backwards-compatibility
guarantees.
database_id=self.TEST_DATABASE))
apache_beam/io/gcp/experimental/spannerio_write_it_test.py:135
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:135:
FutureWarning: WriteToSpanner is experimental. No backwards-compatibility
guarantees.
max_batch_size_bytes=250))
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-df-py37.xml>
-
[33m[1m============= 5 passed, 10 skipped, 5 warnings in 1767.26 seconds
==============[0m
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/direct/common.gradle'>
line: 173
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py37:directRunnerIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 120
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 21m 4s
217 actionable tasks: 153 executed, 60 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/7dint6waz36q6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
