See
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/129/display/redirect?page=changes>
Changes:
[Robin Qiu] Update Beam website to release 2.25.0.
------------------------------------------
[...truncated 347.11 KB...]
"urn": "beam:metric:sampled_byte_size:v1",
"type": "beam:metrics:distribution_int64:v1",
"payload": "ARUVFQ==",
"labels": {
"PCOLLECTION": "ref_PCollection_PCollection_15"
}
}, {
"urn": "beam:metric:sampled_byte_size:v1",
"type": "beam:metrics:distribution_int64:v1",
"payload": "ARMTEw==",
"labels": {
"PCOLLECTION": "ref_PCollection_PCollection_17:1"
}
}, {
"urn": "beam:metric:user:sum_int64:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "Aw==",
"labels": {
"NAMESPACE": "org.apache.beam.runners.core.LateDataDroppingDoFnRunner",
"NAME": "droppedDueToLateness",
"PTRANSFORM": "assert_that/Group/GroupByKey"
}
}]
}
}
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.taskexecutor.JobLeaderService
stop
INFO: Stop job leader service.
Oct 24, 2020 6:58:40 AM
org.apache.flink.runtime.taskexecutor.TaskExecutor$JobLeaderListenerImpl
jobManagerLostLeadership
INFO: JobManager for job bba679616e962c226082121901eea98d with leader id
bd58c161b54115c80550f2249c4a4357 lost leadership.
Oct 24, 2020 6:58:40 AM
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
Oct 24, 2020 6:58:40 AM
org.apache.flink.runtime.registration.RetryingRegistration
lambda$startRegistration$1
INFO: Could not resolve JobManager address akka://flink/user/jobmanager_67,
retrying in 10000 ms: Could not connect to rpc endpoint under address
akka://flink/user/jobmanager_67..
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl
lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory
/tmp/flink-io-3aad5112-bbf6-494a-9dc3-8f3283853cfe
Oct 24, 2020 6:58:40 AM
org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO: Shutting down the network environment and its components.
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl
lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory
/tmp/flink-netty-shuffle-51063672-6afa-471f-9b27-da817a06c2f9
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.taskexecutor.KvStateService
shutdown
INFO: Shutting down the kvState service and its components.
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.taskexecutor.JobLeaderService
stop
INFO: Stop job leader service.
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.filecache.FileCache shutdown
INFO: removed file cache directory
/tmp/flink-dist-cache-8b8f6d8c-cb14-4a69-a55a-df2e314467b3
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
handleOnStopException
INFO: Stopped TaskExecutor akka://flink/user/taskmanager_66.
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint
lambda$shutDownInternal$5
INFO: Removing cache directory /tmp/flink-web-ui
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.rest.RestServerEndpoint
lambda$closeAsync$1
INFO: Shut down complete.
Oct 24, 2020 6:58:40 AM
org.apache.flink.runtime.resourcemanager.ResourceManager deregisterApplication
INFO: Shut down cluster because application is in CANCELED, diagnostics
DispatcherResourceManagerComponent has been closed..
Oct 24, 2020 6:58:40 AM
org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent
closeAsyncInternal
INFO: Closing components.
Oct 24, 2020 6:58:40 AM
org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess
closeInternal
INFO: Stopping SessionDispatcherLeaderProcess.
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO: Stopping dispatcher akka://flink/user/dispatcher.
Oct 24, 2020 6:58:40 AM
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl close
INFO: Closing the SlotManager.
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.dispatcher.Dispatcher
terminateJobManagerRunners
INFO: Stopping all currently running jobs of dispatcher
akka://flink/user/dispatcher.
Oct 24, 2020 6:58:40 AM
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl suspend
INFO: Suspending the SlotManager.
Oct 24, 2020 6:58:40 AM
org.apache.flink.runtime.rest.handler.legacy.backpressure.BackPressureRequestCoordinator
shutDown
INFO: Shutting down back pressure request coordinator.
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.dispatcher.Dispatcher
lambda$onStop$1
INFO: Stopped dispatcher akka://flink/user/dispatcher.
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:307 Make sure that locally built Python SDK
docker image has Python 3.8 interpreter.
--------------------------- Captured stderr teardown ---------------------------
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
stopService
INFO: Stopping Akka RPC service.
Oct 24, 2020 6:58:40 AM org.apache.beam.runners.flink.metrics.FileReporter close
INFO: wrote metrics to
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/tmp/flinktest-confa0yhp1m9/test-metrics.txt>
Oct 24, 2020 6:58:40 AM
akka.event.slf4j.Slf4jLogger$$anonfun$receive$1$$anonfun$applyOrElse$3
apply$mcV$sp
INFO: Shutting down remote daemon.
Oct 24, 2020 6:58:40 AM
akka.event.slf4j.Slf4jLogger$$anonfun$receive$1$$anonfun$applyOrElse$3
apply$mcV$sp
INFO: Remote daemon shut down; proceeding with flushing remote transports.
Oct 24, 2020 6:58:40 AM
akka.event.slf4j.Slf4jLogger$$anonfun$receive$1$$anonfun$applyOrElse$3
apply$mcV$sp
INFO: Remoting shut down.
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
stopService
INFO: Stopping Akka RPC service.
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
lambda$stopService$5
INFO: Stopped Akka RPC service.
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.blob.BlobServer close
INFO: Stopped BLOB server at 0.0.0.0:42505
Oct 24, 2020 6:58:40 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
lambda$stopService$5
INFO: Stopped Akka RPC service.
=============================== warnings summary ===============================
target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42:
DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use
"async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_expand_kafka_read
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_expand_kafka_write
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_external_transform
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_expand_kafka_read
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_expand_kafka_write
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_external_transform
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/coders/coder_impl.py>:222:
DeprecationWarning: tostring() is deprecated. Use tobytes() instead.
self.encode_to_stream(value, out, False)
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/coders/coder_impl.py>:227:
DeprecationWarning: fromstring() is deprecated. Use frombytes() instead.
return self.decode_from_stream(create_InputStream(encoded), False)
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/coders/coder_impl.py>:234:
DeprecationWarning: tostring() is deprecated. Use tobytes() instead.
self.encode_to_stream(value, out, nested)
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/coders/coder_impl.py>:1247:
DeprecationWarning: tostring() is deprecated. Use tobytes() instead.
self._value_coder.encode_to_stream(wv.value, out, nested)
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/coders/coder_impl.py>:1268:
DeprecationWarning: fromstring() is deprecated. Use frombytes() instead.
value = self._value_coder.decode_from_stream(in_stream, nested)
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_flink-runner-test.xml>
-
======= 1 failed, 114 passed, 35 skipped, 89 warnings in 974.97 seconds ========
[31mERROR: InvocationError for command
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh>
flink-runner-test apache_beam/runners/portability/flink_runner_test.py
'--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.10/job-server/build/libs/beam-runners-flink-1.10-job-server-2.26.0-SNAPSHOT.jar>
--environment_type=LOOPBACK' (exited with code 1)
[0m[1mflink-runner-test run-test-post: commands[0] | bash
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary
____________________________________
[31mERROR: flink-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK
> FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.6.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 58m 58s
118 actionable tasks: 85 executed, 31 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zbejy4wthg3hs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
No JDK named ‘JDK 1.8 (latest)’ found
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
