See
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/2686/display/redirect?page=changes>
Changes:
[heejong] [BEAM-10397] add missing environment in windowing strategy for
Dataflow
[Kenneth Knowles] [BEAM-10460] Increase
SparkPortableExecutionTest.testExecution timeout
[Kenneth Knowles] Enhance Combine transform for nullability analysis
[Kenneth Knowles] [BEAM-10502] Enable checker in zetasketch extension
------------------------------------------
[...truncated 7.01 MB...]
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/read/ref_PCollection_PCollection_9:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:ptransform_execution_time:total_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_assert_that/Create/FlatMap(\\u003clambda at
core.py:2636\\u003e)_19"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AQ8PDw==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_11"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AQ8PDw==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_10"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AQ0NDQ==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_9"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "ARUVFQ==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_14"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "ARMTEw==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_16:1"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }]'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b'}'
INFO:apache_beam.utils.subprocess_server:b'[flink-metrics-2] INFO
akka.remote.RemoteActorRefProvider$RemotingTerminator - Remote daemon shut
down; proceeding with flushing remote transports.'
INFO:apache_beam.utils.subprocess_server:b'[flink-metrics-2] INFO
akka.remote.RemoteActorRefProvider$RemotingTerminator - Remoting shut down.'
INFO:apache_beam.utils.subprocess_server:b'[flink-metrics-2] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.'
INFO:apache_beam.utils.subprocess_server:b'[flink-metrics-2] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-6]
INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB
cache'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-6]
INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB
cache'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-6]
INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at
0.0.0.0:39947'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-6]
INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC
service.'
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok
test_native_source (apache_beam.io.gcp.bigquery_read_it_test.ReadTests) ...
SKIP: This test doesn't work on these runners: ['PortableRunner', 'FlinkRunner']
INFO:apache_beam.io.gcp.bigquery_read_it_test:Deleting dataset
python_read_table_1594879661994 in project apache-beam-testing
----------------------------------------------------------------------
XML: nosetests-postCommitIT-flink-py36.xml
----------------------------------------------------------------------
XML:
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 4 tests in 48.624s
OK (SKIP=2)
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Sending SIGINT to job_server
> Task :sdks:python:test-suites:portable:py36:postCommitPy36
> Task :sdks:python:test-suites:dataflow:py36:postCommitIT
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-07-16T06:08:15.785Z:
JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-07-16T06:08:15.829Z:
JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-07-16T06:08:19.752Z:
JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-07-16T06:08:19.789Z:
JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-07-16T06:08:22.858Z:
JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-07-16T06:08:22.899Z:
JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-07-16T06:08:27.538Z:
JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-07-16T06:08:27.571Z:
JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-07-16T06:08:25.145Z:
JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-07-16T06:08:25.182Z:
JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-07-16T06:08:32.190Z:
JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-07-16T06:08:32.220Z:
JOB_MESSAGE_DETAILED: Workers have started successfully.
Traceback (most recent call last):
File "setup.py", line 339, in <module>
'mypy': generate_protos_first(mypy),
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/setuptools/__init__.py";,>
line 165, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python3.6/distutils/core.py", line 148, in setup
dist.run_commands()
File "/usr/lib/python3.6/distutils/dist.py", line 955, in run_commands
self.run_command(cmd)
File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/nose/commands.py";,>
line 158, in run
TestProgram(argv=argv, config=self.__config)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/nose/core.py";,>
line 121, in __init__
**extra_args)
File "/usr/lib/python3.6/unittest/main.py", line 95, in __init__
self.runTests()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/nose/core.py";,>
line 207, in runTests
result = self.testRunner.run(self.test)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/nose/plugins/multiprocess.py";,>
line 396, in run
timeout=nexttimeout)
File "<string>", line 2, in get
File "/usr/lib/python3.6/multiprocessing/managers.py", line 757, in
_callmethod
kind, result = conn.recv()
File "/usr/lib/python3.6/multiprocessing/connection.py", line 250, in recv
buf = self._recv_bytes()
File "/usr/lib/python3.6/multiprocessing/connection.py", line 407, in
_recv_bytes
buf = self._recv(4)
File "/usr/lib/python3.6/multiprocessing/connection.py", line 383, in _recv
raise EOFError
EOFError
Terminated
> Task :sdks:python:test-suites:dataflow:py36:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 116
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py36:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 143
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 2s
111 actionable tasks: 95 executed, 16 from cache
Publishing build scan...
failed to abort Gradle Worker Daemon 4
org.gradle.process.internal.ExecException: A problem occurred waiting for
process 'Gradle Worker Daemon 4' to complete.
at
org.gradle.process.internal.DefaultExecHandle.execExceptionFor(DefaultExecHandle.java:232)
at
org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:209)
at
org.gradle.process.internal.DefaultExecHandle.failed(DefaultExecHandle.java:356)
at
org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:86)
at
org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalStateException: Shutdown in progress
at
java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82)
at java.lang.Runtime.removeShutdownHook(Runtime.java:239)
at
org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:33)
at
org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:199)
at
org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:352)
at
org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:107)
at
org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:83)
... 7 more
failed to abort Gradle Worker Daemon 2
org.gradle.process.internal.ExecException: A problem occurred waiting for
process 'Gradle Worker Daemon 2' to complete.
at
org.gradle.process.internal.DefaultExecHandle.execExceptionFor(DefaultExecHandle.java:232)
at
org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:209)
at
org.gradle.process.internal.DefaultExecHandle.failed(DefaultExecHandle.java:356)
at
org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:86)
at
org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalStateException: Shutdown in progress
at
java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82)
at java.lang.Runtime.removeShutdownHook(Runtime.java:239)
at
org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:33)
at
org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:199)
at
org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:352)
at
org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:107)
at
org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:83)
... 7 more
failed to abort Gradle Worker Daemon 5
org.gradle.process.internal.ExecException: A problem occurred waiting for
process 'Gradle Worker Daemon 5' to complete.
at
org.gradle.process.internal.DefaultExecHandle.execExceptionFor(DefaultExecHandle.java:232)
at
org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:209)
at
org.gradle.process.internal.DefaultExecHandle.failed(DefaultExecHandle.java:356)
at
org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:86)
at
org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalStateException: Shutdown in progress
at
java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82)
at java.lang.Runtime.removeShutdownHook(Runtime.java:239)
at
org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:33)
at
org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:199)
at
org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:352)
at
org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:107)
at
org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:83)
... 7 more
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=c2fece61-2852-433b-9161-09585ab894e0,
currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 4545
log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-4545.out.log
----- Last 20 lines from daemon log file - daemon-4545.out.log -----
at
org.gradle.process.internal.DefaultExecHandle.execExceptionFor(DefaultExecHandle.java:232)
at
org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:209)
at
org.gradle.process.internal.DefaultExecHandle.failed(DefaultExecHandle.java:356)
at
org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:86)
at
org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalStateException: Shutdown in progress
at
java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82)
at java.lang.Runtime.removeShutdownHook(Runtime.java:239)
at
org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:33)
at
org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:199)
at
org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:352)
at
org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:107)
at
org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:83)
... 7 more
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may
have crashed)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
