[
https://issues.apache.org/jira/browse/FLINK-26248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17494550#comment-17494550
]
zhisheng commented on FLINK-26248:
----------------------------------
delete the TM pod then the JM log:
{code:java}
2022-02-18 11:12:39,319 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 910 (type=CHECKPOINT) @ 1645182759315 for job
7422577421a74b52bb14d76b076728f0.2022-02-18 11:12:40,204 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 910 for job 7422577421a74b52bb14d76b076728f0 (99869 bytes in 879
ms).2022-02-18 11:12:41,319 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 911 (type=CHECKPOINT) @ 1645182761315 for job
7422577421a74b52bb14d76b076728f0.2022-02-18 11:12:41,703 WARN
akka.remote.transport.netty.NettyTransport [] - Remote
connection to [/10.74.2.229:48000] failed with java.io.IOException: Connection
reset by peer2022-02-18 11:12:41,709 WARN
akka.remote.ReliableDeliverySupervisor [] - Association
with remote system [akka.tcp://[email protected]:6122] has failed, address is
now gated for [50] ms. Reason: [Disassociated] 2022-02-18 11:12:41,713 WARN
akka.remote.ReliableDeliverySupervisor [] - Association
with remote system [akka.tcp://[email protected]:40339] has failed,
address is now gated for [50] ms. Reason: [Disassociated] 2022-02-18
11:12:42,647 WARN
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Worker state-machine-cluster-taskmanager-1-1 is terminated. Diagnostics: Pod
terminated, container termination statuses: [flink-task-manager(exitCode=143,
reason=Error, message=null)]2022-02-18 11:12:42,651 WARN
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Closing TaskExecutor connection state-machine-cluster-taskmanager-1-1 because:
Pod terminated, container termination statuses:
[flink-task-manager(exitCode=143, reason=Error, message=null)]2022-02-18
11:12:42,666 WARN org.apache.flink.runtime.executiongraph.ExecutionGraph
[] - Source: Custom Source (1/1) (044fe8cb5885eb314fae6f509e0bab3b) switched
from RUNNING to FAILED on state-machine-cluster-taskmanager-1-1 @ 10.74.2.229
(dataPort=42891).java.lang.Exception: Pod terminated, container termination
statuses: [flink-task-manager(exitCode=143, reason=Error, message=null)] at
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager.onWorkerTerminated(ActiveResourceManager.java:219)
~[flink-dist_2.11-1.12.0.jar:1.12.0] at
org.apache.flink.kubernetes.KubernetesResourceManagerDriver.lambda$terminatedPodsInMainThread$3(KubernetesResourceManagerDriver.java:278)
~[flink-dist_2.11-1.12.0.jar:1.12.0] at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:404)
~[flink-dist_2.11-1.12.0.jar:1.12.0] at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:197)
~[flink-dist_2.11-1.12.0.jar:1.12.0] at
org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:74)
~[flink-dist_2.11-1.12.0.jar:1.12.0] at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:154)
~[flink-dist_2.11-1.12.0.jar:1.12.0] at
akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)
[flink-dist_2.11-1.12.0.jar:1.12.0] at
akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)
[flink-dist_2.11-1.12.0.jar:1.12.0] at
scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
[flink-dist_2.11-1.12.0.jar:1.12.0] at
akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)
[flink-dist_2.11-1.12.0.jar:1.12.0] at
scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170)
[flink-dist_2.11-1.12.0.jar:1.12.0] at
scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
[flink-dist_2.11-1.12.0.jar:1.12.0] at
scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
[flink-dist_2.11-1.12.0.jar:1.12.0] at
akka.actor.Actor$class.aroundReceive(Actor.scala:517)
[flink-dist_2.11-1.12.0.jar:1.12.0] at
akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)
[flink-dist_2.11-1.12.0.jar:1.12.0] at
akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
[flink-dist_2.11-1.12.0.jar:1.12.0] at
akka.actor.ActorCell.invoke(ActorCell.scala:561)
[flink-dist_2.11-1.12.0.jar:1.12.0] at
akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
[flink-dist_2.11-1.12.0.jar:1.12.0] at
akka.dispatch.Mailbox.run(Mailbox.scala:225)
[flink-dist_2.11-1.12.0.jar:1.12.0] at
akka.dispatch.Mailbox.exec(Mailbox.scala:235)
[flink-dist_2.11-1.12.0.jar:1.12.0] at
akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
[flink-dist_2.11-1.12.0.jar:1.12.0] at
akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
[flink-dist_2.11-1.12.0.jar:1.12.0] at
akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
[flink-dist_2.11-1.12.0.jar:1.12.0] at
akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
[flink-dist_2.11-1.12.0.jar:1.12.0]2022-02-18 11:12:42,693 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution
044fe8cb5885eb314fae6f509e0bab3b.2022-02-18 11:12:42,700 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution
044fe8cb5885eb314fae6f509e0bab3b.2022-02-18 11:12:42,713 INFO
org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy
[] - Calculating tasks to restart to recover the failed task
bc764cd8ddf7a0cff126f51c16239658_0.2022-02-18 11:12:42,714 INFO
org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy
[] - 2 tasks should be restarted to recover the failed task
bc764cd8ddf7a0cff126f51c16239658_0. 2022-02-18 11:12:42,717 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job State
machine job (7422577421a74b52bb14d76b076728f0) switched from state RUNNING to
RESTARTING.2022-02-18 11:12:42,795 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Flat Map ->
Sink: Print to Std. Out (1/1) (6c1dddddc37ce9aa065bc64e56fe7e94) switched from
RUNNING to CANCELING.2022-02-18 11:12:42,798 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Flat Map ->
Sink: Print to Std. Out (1/1) (6c1dddddc37ce9aa065bc64e56fe7e94) switched from
CANCELING to CANCELED.2022-02-18 11:12:42,799 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution
6c1dddddc37ce9aa065bc64e56fe7e94.2022-02-18 11:12:43,803 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job State
machine job (7422577421a74b52bb14d76b076728f0) switched from state RESTARTING
to RUNNING.2022-02-18 11:12:43,807 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Restoring job
7422577421a74b52bb14d76b076728f0 from Checkpoint 910 @ 1645182759315 for
7422577421a74b52bb14d76b076728f0 located at
hdfs:/flink/checkpoints/7422577421a74b52bb14d76b076728f0/chk-910.2022-02-18
11:12:43,823 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator
[] - No master state to restore2022-02-18 11:12:43,824 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
Custom Source (1/1) (4f1fb56400991187454732901d9e5565) switched from CREATED to
SCHEDULED.2022-02-18 11:12:43,824 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Flat Map ->
Sink: Print to Std. Out (1/1) (fd359e4dbe951ef398b20490557809a6) switched from
CREATED to SCHEDULED.2022-02-18 11:12:43,825 INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting
new slot [SlotRequestId{df9d23d190d4222731f0e7a37e5a5239}] and profile
ResourceProfile{UNKNOWN} with allocation id c80f00f2e5c7ddd9050c3c7f3b10adc8
from resource manager.2022-02-18 11:12:43,825 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Request slot with profile ResourceProfile{UNKNOWN} for job
7422577421a74b52bb14d76b076728f0 with allocation id
c80f00f2e5c7ddd9050c3c7f3b10adc8.2022-02-18 11:12:43,825 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Requesting new worker with resource spec WorkerResourceSpec {cpuCores=0.5,
taskHeapSize=25.600mb (26843542 bytes), taskOffHeapSize=0 bytes,
networkMemSize=64.000mb (67108864 bytes), managedMemSize=230.400mb (241591914
bytes)}, current pending count: 1.2022-02-18 11:12:43,826 INFO
org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled
external resources: []2022-02-18 11:12:43,830 INFO
org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] - Creating new
TaskManager pod with name state-machine-cluster-taskmanager-1-2 and resource
<1024,0.5>.2022-02-18 11:12:43,855 INFO
org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] - Received new
TaskManager pod: state-machine-cluster-taskmanager-1-22022-02-18 11:12:43,855
INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager []
- Requested worker state-machine-cluster-taskmanager-1-2 with resource spec
WorkerResourceSpec {cpuCores=0.5, taskHeapSize=25.600mb (26843542 bytes),
taskOffHeapSize=0 bytes, networkMemSize=64.000mb (67108864 bytes),
managedMemSize=230.400mb (241591914 bytes)}.2022-02-18 11:12:43,855 INFO
org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] - Pod
state-machine-cluster-taskmanager-1-2 is created.2022-02-18 11:12:44,977 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
7422577421a74b52bb14d76b076728f0 is not in state RUNNING but SCHEDULED instead.
Aborting checkpoint.2022-02-18 11:12:46,977 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
7422577421a74b52bb14d76b076728f0 is not in state RUNNING but SCHEDULED instead.
Aborting checkpoint.2022-02-18 11:12:48,977 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
7422577421a74b52bb14d76b076728f0 is not in state RUNNING but SCHEDULED instead.
Aborting checkpoint.2022-02-18 11:12:50,977 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
7422577421a74b52bb14d76b076728f0 is not in state RUNNING but SCHEDULED instead.
Aborting checkpoint.2022-02-18 11:12:52,977 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
7422577421a74b52bb14d76b076728f0 is not in state RUNNING but SCHEDULED instead.
Aborting checkpoint.2022-02-18 11:12:54,977 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
7422577421a74b52bb14d76b076728f0 is not in state RUNNING but SCHEDULED instead.
Aborting checkpoint.2022-02-18 11:12:56,977 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
7422577421a74b52bb14d76b076728f0 is not in state RUNNING but SCHEDULED instead.
Aborting checkpoint.2022-02-18 11:12:58,977 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
7422577421a74b52bb14d76b076728f0 is not in state RUNNING but SCHEDULED instead.
Aborting checkpoint.2022-02-18 11:13:00,977 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
7422577421a74b52bb14d76b076728f0 is not in state RUNNING but SCHEDULED instead.
Aborting checkpoint.2022-02-18 11:13:01,773 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Registering TaskManager with ResourceID state-machine-cluster-taskmanager-1-2
(akka.tcp://[email protected]:6122/user/rpc/taskmanager_0) at
ResourceManager2022-02-18 11:13:01,793 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Worker state-machine-cluster-taskmanager-1-2 is registered.2022-02-18
11:13:01,794 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Worker state-machine-cluster-taskmanager-1-2 with resource spec
WorkerResourceSpec {cpuCores=0.5, taskHeapSize=25.600mb (26843542 bytes),
taskOffHeapSize=0 bytes, networkMemSize=64.000mb (67108864 bytes),
managedMemSize=230.400mb (241591914 bytes)} was requested in current attempt.
Current pending count after registering: 0.2022-02-18 11:13:02,084 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
Custom Source (1/1) (4f1fb56400991187454732901d9e5565) switched from SCHEDULED
to DEPLOYING.2022-02-18 11:13:02,084 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying
Source: Custom Source (1/1) (attempt #1) with attempt id
4f1fb56400991187454732901d9e5565 to state-machine-cluster-taskmanager-1-2 @
10.74.2.230 (dataPort=45409) with allocation id
c80f00f2e5c7ddd9050c3c7f3b10adc82022-02-18 11:13:02,086 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Flat Map ->
Sink: Print to Std. Out (1/1) (fd359e4dbe951ef398b20490557809a6) switched from
SCHEDULED to DEPLOYING.2022-02-18 11:13:02,086 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying
Flat Map -> Sink: Print to Std. Out (1/1) (attempt #1) with attempt id
fd359e4dbe951ef398b20490557809a6 to state-machine-cluster-taskmanager-1-2 @
10.74.2.230 (dataPort=45409) with allocation id
c80f00f2e5c7ddd9050c3c7f3b10adc82022-02-18 11:13:02,696 WARN
akka.remote.transport.netty.NettyTransport [] - Remote
connection to [null] failed with
org.apache.flink.shaded.akka.org.jboss.netty.channel.ConnectTimeoutException:
connection timed out: /10.74.2.229:61222022-02-18 11:13:02,698 WARN
akka.remote.ReliableDeliverySupervisor [] - Association
with remote system [akka.tcp://[email protected]:6122] has failed, address is
now gated for [50] ms. Reason: [Association failed with
[akka.tcp://[email protected]:6122]] Caused by: [No response from remote for
outbound association. Associate timed out after [20000 ms].]2022-02-18
11:13:02,698 INFO akka.remote.transport.ProtocolStateActor
[] - No response from remote for outbound association. Associate timed out
after [20000 ms].2022-02-18 11:13:02,977 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
7422577421a74b52bb14d76b076728f0 is not in state RUNNING but DEPLOYING instead.
Aborting checkpoint.2022-02-18 11:13:04,977 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
7422577421a74b52bb14d76b076728f0 is not in state RUNNING but DEPLOYING instead.
Aborting checkpoint.2022-02-18 11:13:06,977 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
7422577421a74b52bb14d76b076728f0 is not in state RUNNING but DEPLOYING instead.
Aborting checkpoint.2022-02-18 11:13:07,673 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Flat Map ->
Sink: Print to Std. Out (1/1) (fd359e4dbe951ef398b20490557809a6) switched from
DEPLOYING to RUNNING.2022-02-18 11:13:07,674 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
Custom Source (1/1) (4f1fb56400991187454732901d9e5565) switched from DEPLOYING
to RUNNING.2022-02-18 11:13:08,985 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 912 (type=CHECKPOINT) @ 1645182788977 for job
7422577421a74b52bb14d76b076728f0.2022-02-18 11:13:11,708 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 912 for job 7422577421a74b52bb14d76b076728f0 (9055 bytes in 2723
ms).2022-02-18 11:13:11,712 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 913 (type=CHECKPOINT) @ 1645182791709 for job
7422577421a74b52bb14d76b076728f0.2022-02-18 11:13:12,215 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 913 for job 7422577421a74b52bb14d76b076728f0 (15747 bytes in 497
ms).2022-02-18 11:13:12,980 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 914 (type=CHECKPOINT) @ 1645182792977 for job
7422577421a74b52bb14d76b076728f0.2022-02-18 11:13:13,150 WARN
akka.remote.transport.netty.NettyTransport [] - Remote
connection to [null] failed with java.net.NoRouteToHostException: No route to
host2022-02-18 11:13:13,160 WARN akka.remote.ReliableDeliverySupervisor
[] - Association with remote system
[akka.tcp://[email protected]:6122] has failed, address is now gated for [50]
ms. Reason: [Association failed with [akka.tcp://[email protected]:6122]]
Caused by: [java.net.NoRouteToHostException: No route to host]2022-02-18
11:13:13,427 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator
[] - Completed checkpoint 914 for job 7422577421a74b52bb14d76b076728f0 (33774
bytes in 444 ms).2022-02-18 11:13:14,981 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 915 (type=CHECKPOINT) @ 1645182794977 for job
7422577421a74b52bb14d76b076728f0.2022-02-18 11:13:15,431 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 915 for job 7422577421a74b52bb14d76b076728f0 (25079 bytes in 448
ms).2022-02-18 11:13:16,981 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 916 (type=CHECKPOINT) @ 1645182796977 for job
7422577421a74b52bb14d76b076728f0.2022-02-18 11:13:17,429 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 916 for job 7422577421a74b52bb14d76b076728f0 (24904 bytes in 446
ms). {code}
delete the JM pod, then the new JM log:
{code:java}
2022-02-18 11:15:16,509 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
--------------------------------------------------------------------------------
2022-02-18 11:15:16,514 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting
KubernetesApplicationClusterEntrypoint (Version: 1.12.0, Scala: 2.11,
Rev:a41d55f, Date:2021-12-09T10:38:36+01:00)
2022-02-18 11:15:16,514 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - OS current
user: flink
2022-02-18 11:15:17,114 WARN org.apache.hadoop.util.NativeCodeLoader
[] - Unable to load native-hadoop library for your platform... using
builtin-java classes where applicable
2022-02-18 11:15:17,308 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Current
Hadoop/Kerberos user: flink
2022-02-18 11:15:17,308 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM: OpenJDK
64-Bit Server VM - Oracle Corporation - 1.8/25.322-b06
2022-02-18 11:15:17,308 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Maximum heap
size: 1024 MiBytes
2022-02-18 11:15:17,308 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JAVA_HOME:
/usr/local/openjdk-8
2022-02-18 11:15:17,311 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Hadoop
version: 2.7.3
2022-02-18 11:15:17,311 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM Options:
2022-02-18 11:15:17,311 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Xmx1073741824
2022-02-18 11:15:17,311 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Xms1073741824
2022-02-18 11:15:17,311 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:MaxMetaspaceSize=268435456
2022-02-18 11:15:17,311 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Denv=dev
2022-02-18 11:15:17,311 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlog4j2.formatMsgNoLookups=true
2022-02-18 11:15:17,311 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Xloggc:./gc-%t.log
2022-02-18 11:15:17,311 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:+PrintGCDetails
2022-02-18 11:15:17,312 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:-OmitStackTraceInFastThrow
2022-02-18 11:15:17,312 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:+PrintGCTimeStamps
2022-02-18 11:15:17,312 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:+PrintHeapAtGC
2022-02-18 11:15:17,312 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:+PrintGCDateStamps
2022-02-18 11:15:17,312 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:+UseGCLogFileRotation
2022-02-18 11:15:17,312 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:+PrintReferenceGC
2022-02-18 11:15:17,312 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:+PrintTenuringDistribution
2022-02-18 11:15:17,312 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:NumberOfGCLogFiles=5
2022-02-18 11:15:17,312 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:GCLogFileSize=20M
2022-02-18 11:15:17,312 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:+PrintPromotionFailure
2022-02-18 11:15:17,312 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:+PrintGCCause
2022-02-18 11:15:17,312 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:+UseG1GC
2022-02-18 11:15:17,312 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:+UnlockExperimentalVMOptions
2022-02-18 11:15:17,312 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:+UnlockDiagnosticVMOptions
2022-02-18 11:15:17,312 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:MaxGCPauseMillis=200
2022-02-18 11:15:17,313 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:-ResizePLAB
2022-02-18 11:15:17,313 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:+ParallelRefProcEnabled
2022-02-18 11:15:17,313 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:ParallelGCThreads=8
2022-02-18 11:15:17,313 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:ConcGCThreads=4
2022-02-18 11:15:17,313 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:G1HeapWastePercent=3
2022-02-18 11:15:17,313 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:InitiatingHeapOccupancyPercent=35
2022-02-18 11:15:17,313 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:G1MixedGCLiveThresholdPercent=85
2022-02-18 11:15:17,313 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlog.file=/opt/flink/log/jobmanager.log
2022-02-18 11:15:17,313 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlogback.configurationFile=file:/opt/flink/conf/logback-console.xml
2022-02-18 11:15:17,313 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlog4j.configuration=file:/opt/flink/conf/log4j-console.properties
2022-02-18 11:15:17,313 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlog4j.configurationFile=file:/opt/flink/conf/log4j-console.properties
2022-02-18 11:15:17,313 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Program
Arguments:
2022-02-18 11:15:17,315 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2022-02-18 11:15:17,315 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.off-heap.size=134217728b
2022-02-18 11:15:17,315 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2022-02-18 11:15:17,315 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.jvm-overhead.min=201326592b
2022-02-18 11:15:17,315 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2022-02-18 11:15:17,315 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.jvm-metaspace.size=268435456b
2022-02-18 11:15:17,315 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2022-02-18 11:15:17,315 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.heap.size=1073741824b
2022-02-18 11:15:17,315 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2022-02-18 11:15:17,315 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.jvm-overhead.max=201326592b
2022-02-18 11:15:17,315 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Classpath:
/opt/flink/lib/Log4j2KafkaAppender-1.0.jar:/opt/flink/lib/flink-connector-jdbc_2.11-1.12.0.jar:/opt/flink/lib/flink-csv-1.12.0.jar:/opt/flink/lib/flink-json-1.12.0.jar:/opt/flink/lib/flink-metrics-kafka_2.11-1.12.0.jar:/opt/flink/lib/flink-metrics-prometheus-1.12.0.jar:/opt/flink/lib/flink-sequence-file-1.12.0.jar:/opt/flink/lib/flink-shaded-zookeeper-3.4.14.jar:/opt/flink/lib/flink-sql-avro-1.12.0.jar:/opt/flink/lib/flink-sql-connector-elasticsearch_2.11-1.12.0.jar:/opt/flink/lib/flink-sql-connector-hbase-2.2_2.11-1.12.0.jar:/opt/flink/lib/flink-sql-connector-hive-2.2.0_2.11-1.12.0.jar:/opt/flink/lib/flink-sql-connector-kafka_2.11-1.12.0.jar:/opt/flink/lib/flink-sql-orc_2.11-1.12.0.jar:/opt/flink/lib/flink-sql-parquet_2.11-1.12.0.jar:/opt/flink/lib/flink-table-blink_2.11-1.12.0.jar:/opt/flink/lib/flink-table_2.11-1.12.0.jar:/opt/flink/lib/log4j-1.2-api-2.12.1.jar:/opt/flink/lib/log4j-api-2.12.1.jar:/opt/flink/lib/log4j-core-2.12.1.jar:/opt/flink/lib/log4j-slf4j-impl-2.12.1.jar:/opt/flink/lib/mysql-connector-java-5.1.47.jar:/opt/flink/lib/postgresql-42.2.8.jar:/opt/flink/lib/flink-dist_2.11-1.12.0.jar:/opt/hadoop/conf:/opt/hadoop/share/hadoop/common/lib/activation-1.1.jar:/opt/hadoop/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/opt/hadoop/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/hadoop/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/opt/hadoop/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/opt/hadoop/share/hadoop/common/lib/asm-3.2.jar:/opt/hadoop/share/hadoop/common/lib/avro-1.7.4.jar:/opt/hadoop/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/opt/hadoop/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/opt/hadoop/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/hadoop/share/hadoop/common/lib/commons-codec-1.4.jar:/opt/hadoop/share/hadoop/common/lib/commons-collections-3.2.2.jar:/opt/hadoop/share/hadoop/common/lib/commons-compress-1.4.1.jar:/opt/hadoop/share/hadoop/common/lib/commons-configuration-1.6.jar:/opt/hadoop/share/hadoop/common/lib/commons-digester-1.8.jar:/opt/hadoop/share/hadoop/common/lib/commons-httpclient-3.1.jar:/opt/hadoop/share/hadoop/common/lib/commons-io-2.4.jar:/opt/hadoop/share/hadoop/common/lib/commons-lang-2.6.jar:/opt/hadoop/share/hadoop/common/lib/commons-logging-1.1.3.jar:/opt/hadoop/share/hadoop/common/lib/commons-math3-3.1.1.jar:/opt/hadoop/share/hadoop/common/lib/commons-net-3.1.jar:/opt/hadoop/share/hadoop/common/lib/curator-client-2.7.1.jar:/opt/hadoop/share/hadoop/common/lib/curator-framework-2.7.1.jar:/opt/hadoop/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/opt/hadoop/share/hadoop/common/lib/gson-2.2.4.jar:/opt/hadoop/share/hadoop/common/lib/guava-11.0.2.jar:/opt/hadoop/share/hadoop/common/lib/hadoop-annotations-2.7.3.jar:/opt/hadoop/share/hadoop/common/lib/hadoop-auth-2.7.3.jar:/opt/hadoop/share/hadoop/common/lib/hamcrest-core-1.3.jar:/opt/hadoop/share/hadoop/common/lib/-rack-awareness-policy-1.0.jar:/opt/hadoop/share/hadoop/common/lib/htrace-core-3.1.0-incubating.jar:/opt/hadoop/share/hadoop/common/lib/httpclient-4.2.5.jar:/opt/hadoop/share/hadoop/common/lib/httpcore-4.2.5.jar:/opt/hadoop/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/opt/hadoop/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/opt/hadoop/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/opt/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop/share/hadoop/common/lib/jersey-core-1.9.jar:/opt/hadoop/share/hadoop/common/lib/jersey-json-1.9.jar:/opt/hadoop/share/hadoop/common/lib/jersey-server-1.9.jar:/opt/hadoop/share/hadoop/common/lib/jets3t-0.9.0.jar:/opt/hadoop/share/hadoop/common/lib/jettison-1.1.jar:/opt/hadoop/share/hadoop/common/lib/jetty-6.1.26.jar:/opt/hadoop/share/hadoop/common/lib/jetty-util-6.1.26.jar:/opt/hadoop/share/hadoop/common/lib/jsch-0.1.42.jar:/opt/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar:/opt/hadoop/share/hadoop/common/lib/jsr305-3.0.0.jar:/opt/hadoop/share/hadoop/common/lib/junit-4.11.jar:/opt/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar:/opt/hadoop/share/hadoop/common/lib/mockito-all-1.8.5.jar:/opt/hadoop/share/hadoop/common/lib/netty-3.6.2.Final.jar:/opt/hadoop/share/hadoop/common/lib/paranamer-2.3.jar:/opt/hadoop/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/opt/hadoop/share/hadoop/common/lib/servlet-api-2.5.jar:/opt/hadoop/share/hadoop/common/lib/slf4j-api-1.7.10.jar:/opt/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar:/opt/hadoop/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/opt/hadoop/share/hadoop/common/lib/stax-api-1.0-2.jar:/opt/hadoop/share/hadoop/common/lib/xmlenc-0.52.jar:/opt/hadoop/share/hadoop/common/lib/xz-1.0.jar:/opt/hadoop/share/hadoop/common/lib/zookeeper-3.4.6.jar:/opt/hadoop/share/hadoop/common/hadoop-common-2.7.3-tests.jar:/opt/hadoop/share/hadoop/common/hadoop-common-2.7.3.jar:/opt/hadoop/share/hadoop/common/hadoop-nfs-2.7.3.jar:/opt/hadoop/share/hadoop/hdfs:/opt/hadoop/share/hadoop/hdfs/lib/asm-3.2.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-io-2.4.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/opt/hadoop/share/hadoop/hdfs/lib/guava-11.0.2.jar:/opt/hadoop/share/hadoop/hdfs/lib/-block-placement-policy-1.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/htrace-core-3.1.0-incubating.jar:/opt/hadoop/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/opt/hadoop/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/opt/hadoop/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/opt/hadoop/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/opt/hadoop/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/opt/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/ranger-hdfs-plugin-shim-1.1.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/ranger-plugin-classloader-1.1.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/opt/hadoop/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/opt/hadoop/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/opt/hadoop/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.7.3-tests.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.7.3.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-nfs-2.7.3.jar:/opt/hadoop/share/hadoop/yarn/lib/activation-1.1.jar:/opt/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop/share/hadoop/yarn/lib/asm-3.2.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-cli-1.2.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-codec-1.4.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-io-2.4.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-lang-2.6.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/opt/hadoop/share/hadoop/yarn/lib/guava-11.0.2.jar:/opt/hadoop/share/hadoop/yarn/lib/guice-3.0.jar:/opt/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/opt/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/opt/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/opt/hadoop/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop/share/hadoop/yarn/lib/jersey-client-1.9.jar:/opt/hadoop/share/hadoop/yarn/lib/jersey-core-1.9.jar:/opt/hadoop/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/opt/hadoop/share/hadoop/yarn/lib/jersey-json-1.9.jar:/opt/hadoop/share/hadoop/yarn/lib/jersey-server-1.9.jar:/opt/hadoop/share/hadoop/yarn/lib/jettison-1.1.jar:/opt/hadoop/share/hadoop/yarn/lib/jetty-6.1.26.jar:/opt/hadoop/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/opt/hadoop/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/opt/hadoop/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/opt/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar:/opt/hadoop/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/opt/hadoop/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/opt/hadoop/share/hadoop/yarn/lib/servlet-api-2.5.jar:/opt/hadoop/share/hadoop/yarn/lib/spark-2.3.1-yarn-shuffle.jar:/opt/hadoop/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/opt/hadoop/share/hadoop/yarn/lib/xz-1.0.jar:/opt/hadoop/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/opt/hadoop/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.7.3.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.3.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.7.3.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.3.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-registry-2.7.3.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.3.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.7.3.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.3.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.3.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.3.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.3.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.3.jar:/opt/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/opt/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar:/opt/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/opt/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/opt/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar:/opt/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/opt/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.3.jar:/opt/hadoop/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/opt/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar:/opt/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/opt/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/opt/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/opt/hadoop/share/hadoop/mapreduce/lib/junit-4.11.jar:/opt/hadoop/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/opt/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/opt/hadoop/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/opt/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/opt/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/opt/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/opt/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.3.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.3.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.3.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.3.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.3.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3-tests.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.3.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar:/opt/hadoop/share/hadoop/tools/lib/hadoop-aliyun-2.9.2-jar-with-dependencies.jar:/opt/hadoop/conf:
2022-02-18 11:15:17,316 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
--------------------------------------------------------------------------------
2022-02-18 11:15:17,317 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Registered
UNIX signal handlers for [TERM, HUP, INT]
2022-02-18 11:15:17,329 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.lingerMs, 5
2022-02-18 11:15:17,329 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: env.java.opts, -Denv=dev
-Dlog4j2.formatMsgNoLookups=true -Xloggc:./gc-%t.log -XX:+PrintGCDetails
-XX:-OmitStackTraceInFastThrow -XX:+PrintGCTimeStamps -XX:+PrintHeapAtGC
-XX:+PrintGCDateStamps -XX:+UseGCLogFileRotation -XX:+PrintReferenceGC
-XX:+PrintTenuringDistribution -XX:NumberOfGCLogFiles=5 -XX:GCLogFileSize=20M
-XX:+PrintPromotionFailure -XX:+PrintGCCause -XX:+UseG1GC
-XX:+UnlockExperimentalVMOptions -XX:+UnlockDiagnosticVMOptions
-XX:MaxGCPauseMillis=200 -XX:-ResizePLAB -XX:+ParallelRefProcEnabled
-XX:ParallelGCThreads=8 -XX:ConcGCThreads=4 -XX:G1HeapWastePercent=3
-XX:InitiatingHeapOccupancyPercent=35 -XX:G1MixedGCLiveThresholdPercent=85
2022-02-18 11:15:17,329 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.rpc.address, state-machine-cluster.hke-flink
2022-02-18 11:15:17,329 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.bootstrapServers,
http://fat-kafka1.tt.com.cn:9092,http://fat-kafka2.tt.com.cn:9092,http://fat-kafka3.tt.com.cn:9092
2022-02-18 11:15:17,329 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.cluster-id, state-machine-cluster
2022-02-18 11:15:17,329 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability.storageDir, hdfs:///flink/ha/k8s
2022-02-18 11:15:17,329 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.maxRequestSize, 1048576
2022-02-18 11:15:17,330 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.retries, 0
2022-02-18 11:15:17,330 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: parallelism.default, 1
2022-02-18 11:15:17,330 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.namespace, hke-flink
2022-02-18 11:15:17,330 WARN
org.apache.flink.configuration.GlobalConfiguration [] - Error while
trying to split key and value in configuration file
/opt/flink/conf/flink-conf.yaml:11: "pipeline.classpaths: "
2022-02-18 11:15:17,330 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.archive.fs.dir,
hdfs:///flink/completed-jobs/
2022-02-18 11:15:17,330 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.class,
org.apache.flink.metrics.kafka.KafkaReporter
2022-02-18 11:15:17,330 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.process.size, 1024m
2022-02-18 11:15:17,330 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.internal.jobmanager.entrypoint.class,
org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint
2022-02-18 11:15:17,330 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: state.backend.incremental, true
2022-02-18 11:15:17,330 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.archive.fs.refresh-interval, 10000
2022-02-18 11:15:17,331 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.rpc.port, 6123
2022-02-18 11:15:17,331 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability.zookeeper.quorum,
10.69.1.15:2181,10.69.1.16:2181,10.69.1.17:2181
2022-02-18 11:15:17,331 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: state.backend, rocksdb
2022-02-18 11:15:17,331 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.requestTimeoutMs, 30
2022-02-18 11:15:17,331 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.jobmanager.service-account, flink
2022-02-18 11:15:17,331 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: blob.server.port, 6124
2022-02-18 11:15:17,331 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: state.checkpoints.num-retained, 2
2022-02-18 11:15:17,331 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.web.port, 8082
2022-02-18 11:15:17,331 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.acks, 0
2022-02-18 11:15:17,331 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.batchSize, 16384
2022-02-18 11:15:17,331 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.topic, metrics-yarn-flink-jobs
2022-02-18 11:15:17,332 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.execution.failover-strategy, region
2022-02-18 11:15:17,332 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: state.savepoints.dir, hdfs:///flink/savepoints
2022-02-18 11:15:17,332 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.taskmanager.cpu, 0.5
2022-02-18 11:15:17,332 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.compressionType, lz4
2022-02-18 11:15:17,332 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.savepoint.ignore-unclaimed-state, false
2022-02-18 11:15:17,332 WARN
org.apache.flink.configuration.GlobalConfiguration [] - Error while
trying to split key and value in configuration file
/opt/flink/conf/flink-conf.yaml:34: "$internal.application.program-args: "
2022-02-18 11:15:17,332 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.container.image,
harbor..cn/flink/statemachine:v0.0.6
2022-02-18 11:15:17,332 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.numberOfTaskSlots, 1
2022-02-18 11:15:17,332 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.rest-service.exposed.type, NodePort
2022-02-18 11:15:17,332 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.bufferMemory, 33554432
2022-02-18 11:15:17,332 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.jobmanager.node-selector,
kubernetes.io/role:flink-node
2022-02-18 11:15:17,333 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.archive.fs.dir, hdfs:///flink/completed-jobs/
2022-02-18 11:15:17,333 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.target, kubernetes-application
2022-02-18 11:15:17,333 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.memory.process.size, 1600m
2022-02-18 11:15:17,333 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.container.image.pull-secrets, ******
2022-02-18 11:15:17,333 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.rpc.port, 6122
2022-02-18 11:15:17,333 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.attached, true
2022-02-18 11:15:17,333 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: internal.cluster.execution-mode, NORMAL
2022-02-18 11:15:17,333 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.shutdown-on-attached-exit, false
2022-02-18 11:15:17,333 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: pipeline.jars,
local:///opt/flink/usrlib/StateMachineExample.jar
2022-02-18 11:15:17,333 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.taskmanager.node-selector,
kubernetes.io/role:flink-node
2022-02-18 11:15:17,333 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: state.checkpoints.dir, hdfs:///flink/checkpoints
2022-02-18 11:15:17,530 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting
KubernetesApplicationClusterEntrypoint.
2022-02-18 11:15:17,538 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install
default filesystem.
2022-02-18 11:15:17,595 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install
security context.
2022-02-18 11:15:17,723 INFO
org.apache.flink.runtime.security.modules.HadoopModule [] - Hadoop user
set to flink (auth:SIMPLE)
2022-02-18 11:15:17,730 INFO
org.apache.flink.runtime.security.modules.JaasModule [] - Jaas file
will be created as /tmp/jaas-2645769038187868282.conf.
2022-02-18 11:15:17,800 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Initializing
cluster services.
2022-02-18 11:15:17,906 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to
start actor system, external address state-machine-cluster.hke-flink:6123, bind
address 0.0.0.0:6123.
2022-02-18 11:15:19,094 INFO akka.event.slf4j.Slf4jLogger
[] - Slf4jLogger started
2022-02-18 11:15:19,117 INFO akka.remote.Remoting
[] - Starting remoting
2022-02-18 11:15:19,400 INFO akka.remote.Remoting
[] - Remoting started; listening on addresses
:[akka.tcp://[email protected]:6123]
2022-02-18 11:15:19,634 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system
started at akka.tcp://[email protected]:6123
2022-02-18 11:15:19,787 INFO org.apache.flink.configuration.Configuration
[] - Config uses fallback configuration key 'jobmanager.rpc.address'
instead of key 'rest.address'
2022-02-18 11:15:19,799 INFO org.apache.flink.runtime.blob.BlobServer
[] - Created BLOB server storage directory
/tmp/blobStore-7246a4f6-6d5e-423d-b799-4979dbfaac45
2022-02-18 11:15:19,804 INFO org.apache.flink.runtime.blob.BlobServer
[] - Started BLOB server at 0.0.0.0:6124 - max concurrent requests:
50 - max backlog: 1000
2022-02-18 11:15:19,821 WARN org.apache.flink.runtime.metrics.ReporterSetup
[] - Multiple implementations of the same reporter were found in
'lib' and/or 'plugins' directories for
org.apache.flink.metrics.prometheus.PrometheusReporterFactory. It is
recommended to remove redundant reporter JARs to resolve used versions'
ambiguity.
2022-02-18 11:15:19,821 WARN org.apache.flink.runtime.metrics.ReporterSetup
[] - Multiple implementations of the same reporter were found in
'lib' and/or 'plugins' directories for
org.apache.flink.metrics.prometheus.PrometheusPushGatewayReporterFactory. It is
recommended to remove redundant reporter JARs to resolve used versions'
ambiguity.
2022-02-18 11:15:19,911 INFO org.apache.kafka.clients.producer.ProducerConfig
[] - ProducerConfig values:
acks = 0
batch.size = 16384
bootstrap.servers = [http://fat-kafka1.tt.com.cn:9092,
http://fat-kafka2.tt.com.cn:9092, http://fat-kafka3.tt.com.cn:9092]
buffer.memory = 33554432
client.dns.lookup = default
client.id = flink_opt_metrics
compression.type = lz4
connections.max.idle.ms = 540000
delivery.timeout.ms = 120000
enable.idempotence = false
interceptor.classes = []
key.serializer = class
org.apache.kafka.common.serialization.StringSerializer
linger.ms = 5
max.block.ms = 60000
max.in.flight.requests.per.connection = 5
max.request.size = 1048576
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partitioner.class = class
org.apache.kafka.clients.producer.internals.DefaultPartitioner
receive.buffer.bytes = 32768
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30
retries = 0
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
security.providers = null
send.buffer.bytes = 131072
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
transaction.timeout.ms = 60000
transactional.id = null
value.serializer = class
org.apache.kafka.common.serialization.StringSerializer2022-02-18 11:15:20,025
INFO org.apache.kafka.common.utils.AppInfoParser [] - Kafka
version: 2.4.1
2022-02-18 11:15:20,025 INFO org.apache.kafka.common.utils.AppInfoParser
[] - Kafka commitId: c57222ae8cd7866b
2022-02-18 11:15:20,025 INFO org.apache.kafka.common.utils.AppInfoParser
[] - Kafka startTimeMs: 1645182920023
2022-02-18 11:15:20,031 INFO
org.apache.flink.runtime.metrics.MetricRegistryImpl [] - Periodically
reporting metrics in intervals of 10 s for reporter kafka of type
org.apache.flink.metrics.kafka.KafkaReporter.
2022-02-18 11:15:20,094 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to
start actor system, external address state-machine-cluster.hke-flink:0, bind
address 0.0.0.0:0.
2022-02-18 11:15:20,110 INFO akka.event.slf4j.Slf4jLogger
[] - Slf4jLogger started
2022-02-18 11:15:20,113 INFO akka.remote.Remoting
[] - Starting remoting
2022-02-18 11:15:20,195 INFO akka.remote.Remoting
[] - Remoting started; listening on addresses
:[akka.tcp://[email protected]:35201]
2022-02-18 11:15:20,308 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system
started at akka.tcp://[email protected]:35201
2022-02-18 11:15:20,397 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Starting RPC endpoint for
org.apache.flink.runtime.metrics.dump.MetricQueryService at
akka://flink-metrics/user/rpc/MetricQueryService .
2022-02-18 11:15:20,597 INFO org.apache.flink.configuration.Configuration
[] - Config uses fallback configuration key 'jobmanager.rpc.address'
instead of key 'rest.address'
2022-02-18 11:15:20,599 INFO
org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Upload
directory /tmp/flink-web-c1f09bcf-fb12-4560-9359-65513cb681dc/flink-web-upload
does not exist.
2022-02-18 11:15:20,600 INFO
org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Created
directory /tmp/flink-web-c1f09bcf-fb12-4560-9359-65513cb681dc/flink-web-upload
for file uploads.
2022-02-18 11:15:20,914 INFO
org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Starting
rest endpoint.
2022-02-18 11:15:21,096 WARN org.apache.kafka.clients.NetworkClient
[] - [Producer clientId=flink_opt_metrics] Bootstrap broker
fat-kafka3.tt.com.cn:9092 (id: -3 rack: null) disconnected
2022-02-18 11:15:21,396 INFO org.apache.kafka.clients.Metadata
[] - [Producer clientId=flink_opt_metrics] Cluster ID:
HUGQ34tqTTWfjqP4fwawuw
2022-02-18 11:15:21,524 INFO
org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined
location of main cluster component log file: /opt/flink/log/jobmanager.log
2022-02-18 11:15:21,524 INFO
org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined
location of main cluster component stdout file: /opt/flink/log/jobmanager.out
2022-02-18 11:15:21,801 INFO
org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Rest
endpoint listening at state-machine-cluster.hke-flink:8081
2022-02-18 11:15:21,803 INFO
org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] -
http://state-machine-cluster.hke-flink:8081 was granted leadership with
leaderSessionID=00000000-0000-0000-0000-000000000000
2022-02-18 11:15:21,804 INFO
org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Web frontend
listening at http://state-machine-cluster.hke-flink:8081.
2022-02-18 11:15:21,821 INFO
org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils [] - The derived
from fraction jvm overhead memory (102.400mb (107374184 bytes)) is less than
its min value 192.000mb (201326592 bytes), min value will be used instead
2022-02-18 11:15:21,822 INFO
org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils [] - The derived
from fraction network memory (57.600mb (60397978 bytes)) is less than its min
value 64.000mb (67108864 bytes), min value will be used instead
2022-02-18 11:15:21,917 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.lingerMs, 5
2022-02-18 11:15:21,917 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: env.java.opts, -Denv=dev
-Dlog4j2.formatMsgNoLookups=true -Xloggc:./gc-%t.log -XX:+PrintGCDetails
-XX:-OmitStackTraceInFastThrow -XX:+PrintGCTimeStamps -XX:+PrintHeapAtGC
-XX:+PrintGCDateStamps -XX:+UseGCLogFileRotation -XX:+PrintReferenceGC
-XX:+PrintTenuringDistribution -XX:NumberOfGCLogFiles=5 -XX:GCLogFileSize=20M
-XX:+PrintPromotionFailure -XX:+PrintGCCause -XX:+UseG1GC
-XX:+UnlockExperimentalVMOptions -XX:+UnlockDiagnosticVMOptions
-XX:MaxGCPauseMillis=200 -XX:-ResizePLAB -XX:+ParallelRefProcEnabled
-XX:ParallelGCThreads=8 -XX:ConcGCThreads=4 -XX:G1HeapWastePercent=3
-XX:InitiatingHeapOccupancyPercent=35 -XX:G1MixedGCLiveThresholdPercent=85
2022-02-18 11:15:21,917 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.rpc.address, state-machine-cluster.hke-flink
2022-02-18 11:15:21,917 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.bootstrapServers,
http://fat-kafka1.tt.com.cn:9092,http://fat-kafka2.tt.com.cn:9092,http://fat-kafka3.tt.com.cn:9092
2022-02-18 11:15:21,917 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.cluster-id, state-machine-cluster
2022-02-18 11:15:21,917 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability.storageDir, hdfs:///flink/ha/k8s
2022-02-18 11:15:21,918 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.maxRequestSize, 1048576
2022-02-18 11:15:21,918 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.retries, 0
2022-02-18 11:15:21,918 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: parallelism.default, 1
2022-02-18 11:15:21,918 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.namespace, hke-flink
2022-02-18 11:15:21,918 WARN
org.apache.flink.configuration.GlobalConfiguration [] - Error while
trying to split key and value in configuration file
/opt/flink/conf/flink-conf.yaml:11: "pipeline.classpaths: "
2022-02-18 11:15:21,918 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.archive.fs.dir,
hdfs:///flink/completed-jobs/
2022-02-18 11:15:21,918 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.class,
org.apache.flink.metrics.kafka.KafkaReporter
2022-02-18 11:15:21,918 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.process.size, 1024m
2022-02-18 11:15:21,918 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.internal.jobmanager.entrypoint.class,
org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint
2022-02-18 11:15:21,918 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: state.backend.incremental, true
2022-02-18 11:15:21,919 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.archive.fs.refresh-interval, 10000
2022-02-18 11:15:21,919 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.rpc.port, 6123
2022-02-18 11:15:21,919 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability.zookeeper.quorum,
10.69.1.15:2181,10.69.1.16:2181,10.69.1.17:2181
2022-02-18 11:15:21,919 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: state.backend, rocksdb
2022-02-18 11:15:21,919 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.requestTimeoutMs, 30
2022-02-18 11:15:21,919 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.jobmanager.service-account, flink
2022-02-18 11:15:21,919 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: blob.server.port, 6124
2022-02-18 11:15:21,919 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: state.checkpoints.num-retained, 2
2022-02-18 11:15:21,919 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.web.port, 8082
2022-02-18 11:15:21,919 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.acks, 0
2022-02-18 11:15:21,919 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.batchSize, 16384
2022-02-18 11:15:21,919 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.topic, metrics-yarn-flink-jobs
2022-02-18 11:15:21,920 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.execution.failover-strategy, region
2022-02-18 11:15:21,920 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: state.savepoints.dir, hdfs:///flink/savepoints
2022-02-18 11:15:21,920 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.taskmanager.cpu, 0.5
2022-02-18 11:15:21,920 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.compressionType, lz4
2022-02-18 11:15:21,920 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.savepoint.ignore-unclaimed-state, false
2022-02-18 11:15:21,920 WARN
org.apache.flink.configuration.GlobalConfiguration [] - Error while
trying to split key and value in configuration file
/opt/flink/conf/flink-conf.yaml:34: "$internal.application.program-args: "
2022-02-18 11:15:21,920 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.container.image,
harbor..cn/flink/statemachine:v0.0.6
2022-02-18 11:15:21,920 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.numberOfTaskSlots, 1
2022-02-18 11:15:21,920 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.rest-service.exposed.type, NodePort
2022-02-18 11:15:21,920 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: metrics.reporter.kafka.bufferMemory, 33554432
2022-02-18 11:15:21,920 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.jobmanager.node-selector,
kubernetes.io/role:flink-node
2022-02-18 11:15:21,920 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.archive.fs.dir, hdfs:///flink/completed-jobs/
2022-02-18 11:15:21,921 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.target, kubernetes-application
2022-02-18 11:15:21,921 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.memory.process.size, 1600m
2022-02-18 11:15:21,921 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.container.image.pull-secrets, ******
2022-02-18 11:15:21,921 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.rpc.port, 6122
2022-02-18 11:15:21,921 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.attached, true
2022-02-18 11:15:21,921 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: internal.cluster.execution-mode, NORMAL
2022-02-18 11:15:21,921 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.shutdown-on-attached-exit, false
2022-02-18 11:15:21,921 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: pipeline.jars,
local:///opt/flink/usrlib/StateMachineExample.jar
2022-02-18 11:15:21,921 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: kubernetes.taskmanager.node-selector,
kubernetes.io/role:flink-node
2022-02-18 11:15:21,921 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: state.checkpoints.dir, hdfs:///flink/checkpoints
2022-02-18 11:15:21,991 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Starting RPC endpoint for
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager at
akka://flink/user/rpc/resourcemanager_0 .
2022-02-18 11:15:22,018 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Start SessionDispatcherLeaderProcess.
2022-02-18 11:15:22,020 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Recover all persisted job graphs.
2022-02-18 11:15:22,021 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Successfully recovered 0 persisted job graphs.
2022-02-18 11:15:22,101 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Starting RPC endpoint for
org.apache.flink.runtime.dispatcher.StandaloneDispatcher at
akka://flink/user/rpc/dispatcher_1 .
2022-02-18 11:15:22,197 INFO org.apache.flink.client.ClientUtils
[] - Starting program (detached: false)
2022-02-18 11:15:22,289 INFO stdout
[] - Usage with built-in data generator: StateMachineExample
[--error-rate <probability-of-invalid-transition>] [--sleep
<sleep-per-record-in-ms>]
2022-02-18 11:15:22,289 INFO stdout
[] - Usage with Kafka: StateMachineExample --kafka-topic <topic>
[--brokers <brokers>]
2022-02-18 11:15:22,289 INFO stdout
[] - Options for both the above setups:
2022-02-18 11:15:22,290 INFO stdout
[] - [--backend <file|rocks>]
2022-02-18 11:15:22,290 INFO stdout
[] - [--checkpoint-dir <filepath>]
2022-02-18 11:15:22,290 INFO stdout
[] - [--async-checkpoints <true|false>]
2022-02-18 11:15:22,290 INFO stdout
[] - [--incremental-checkpoints <true|false>]
2022-02-18 11:15:22,290 INFO stdout
[] - [--output <filepath> OR null for stdout]
2022-02-18 11:15:22,290 INFO stdout
[] -
2022-02-18 11:15:22,291 INFO stdout
[] - Using standalone source with error rate 0.000000 and sleep
delay 1 millis
2022-02-18 11:15:22,291 INFO stdout
[] -
2022-02-18 11:15:22,397 INFO
org.apache.flink.contrib.streaming.state.RocksDBStateBackend [] - Using
predefined options: DEFAULT.
2022-02-18 11:15:22,398 INFO
org.apache.flink.contrib.streaming.state.RocksDBStateBackend [] - Using default
options factory: DefaultConfigurableOptionsFactory{configuredOptions={}}.
2022-02-18 11:15:22,510 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - class
org.apache.flink.streaming.examples.statemachine.event.Event does not contain a
setter for field type
2022-02-18 11:15:22,587 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - Class class
org.apache.flink.streaming.examples.statemachine.event.Event cannot be used as
a POJO type because not all fields are valid POJO fields, and must be processed
as GenericType. Please read the Flink documentation on "Data Types &
Serialization" for details of the effect on performance.
2022-02-18 11:15:22,710 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - class
org.apache.flink.streaming.examples.statemachine.event.Alert does not contain a
setter for field address
2022-02-18 11:15:22,711 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - Class class
org.apache.flink.streaming.examples.statemachine.event.Alert cannot be used as
a POJO type because not all fields are valid POJO fields, and must be processed
as GenericType. Please read the Flink documentation on "Data Types &
Serialization" for details of the effect on performance.
2022-02-18 11:15:23,497 INFO
org.apache.flink.client.deployment.application.executors.EmbeddedExecutor [] -
Job 33257747ba7dc208df7db2707841aef9 is submitted.
2022-02-18 11:15:23,497 INFO
org.apache.flink.client.deployment.application.executors.EmbeddedExecutor [] -
Submitting Job with JobId=33257747ba7dc208df7db2707841aef9.
2022-02-18 11:15:23,893 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Received
JobGraph submission 33257747ba7dc208df7db2707841aef9 (State machine job).
2022-02-18 11:15:23,894 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Submitting
job 33257747ba7dc208df7db2707841aef9 (State machine job).
2022-02-18 11:15:24,100 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Starting RPC endpoint for
org.apache.flink.runtime.jobmaster.JobMaster at
akka://flink/user/rpc/jobmanager_2 .
2022-02-18 11:15:24,204 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Initializing job State machine job
(33257747ba7dc208df7db2707841aef9).
2022-02-18 11:15:24,300 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Using restart back off time strategy
FixedDelayRestartBackoffTimeStrategy(maxNumberRestartAttempts=2147483647,
backoffTimeMS=1000) for State machine job (33257747ba7dc208df7db2707841aef9).
2022-02-18 11:15:24,798 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Running initialization on master for job State machine job
(33257747ba7dc208df7db2707841aef9).
2022-02-18 11:15:24,798 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Successfully ran initialization on master in 0 ms.
2022-02-18 11:15:24,890 INFO
org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built
1 pipelined regions in 0 ms
2022-02-18 11:15:24,903 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Using job/cluster config to configure application-defined state
backend: RocksDBStateBackend{checkpointStreamBackend=File State Backend
(checkpoints: 'hdfs:/flink/checkpoints', savepoints: 'hdfs:/flink/savepoints',
asynchronous: TRUE, fileStateThreshold: 20480), localRocksDbDirectories=null,
enableIncrementalCheckpointing=TRUE, numberOfTransferThreads=1,
writeBatchSize=2097152}
2022-02-18 11:15:24,903 INFO
org.apache.flink.contrib.streaming.state.RocksDBStateBackend [] - Using
predefined options: DEFAULT.
2022-02-18 11:15:24,903 INFO
org.apache.flink.contrib.streaming.state.RocksDBStateBackend [] - Using
application-defined options factory:
DefaultConfigurableOptionsFactory{configuredOptions={}}.
2022-02-18 11:15:24,903 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Using application-defined state backend:
RocksDBStateBackend{checkpointStreamBackend=File State Backend (checkpoints:
'hdfs:/flink/checkpoints', savepoints: 'hdfs:/flink/savepoints', asynchronous:
TRUE, fileStateThreshold: 20480), localRocksDbDirectories=null,
enableIncrementalCheckpointing=TRUE, numberOfTransferThreads=1,
writeBatchSize=2097152}
2022-02-18 11:15:25,997 WARN org.apache.hadoop.hdfs.DFSUtil
[] - Namenode for flashHadoop remains unresolved for ID nn1. Check
your hdfs-site.xml file to ensure namenodes are configured properly.
2022-02-18 11:15:26,000 WARN org.apache.hadoop.hdfs.DFSUtil
[] - Namenode for flashHadoop remains unresolved for ID nn2. Check
your hdfs-site.xml file to ensure namenodes are configured properly.
2022-02-18 11:15:26,095 INFO
org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] - Recovered 1
pods from previous attempts, current attempt id is 2.
2022-02-18 11:15:26,095 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Recovered 1 workers from previous attempt.
2022-02-18 11:15:26,095 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Worker state-machine-cluster-taskmanager-1-2 recovered from previous attempt.
2022-02-18 11:15:26,098 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
ResourceManager
akka.tcp://[email protected]:6123/user/rpc/resourcemanager_0
was granted leadership with fencing token 00000000000000000000000000000000
2022-02-18 11:15:26,102 INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl [] -
Starting the SlotManager.
2022-02-18 11:15:26,823 WARN
org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory [] - The
short-circuit local reads feature cannot be used because libhadoop cannot be
loaded.
2022-02-18 11:15:27,034 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - No checkpoint
found during restore.
2022-02-18 11:15:27,091 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Using failover strategy
org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy@10f8deb3
for State machine job (33257747ba7dc208df7db2707841aef9).
2022-02-18 11:15:27,105 INFO
org.apache.flink.runtime.jobmaster.JobManagerRunnerImpl [] - JobManager
runner for job State machine job (33257747ba7dc208df7db2707841aef9) was granted
leadership with session id 00000000-0000-0000-0000-000000000000 at
akka.tcp://[email protected]:6123/user/rpc/jobmanager_2.
2022-02-18 11:15:27,108 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Starting execution of job State machine job
(33257747ba7dc208df7db2707841aef9) under job master id
00000000000000000000000000000000.
2022-02-18 11:15:27,111 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Starting scheduling with scheduling strategy
[org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
2022-02-18 11:15:27,111 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job State
machine job (33257747ba7dc208df7db2707841aef9) switched from state CREATED to
RUNNING.
2022-02-18 11:15:27,119 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
Custom Source (1/1) (546facd30c896ab8b37be2495ba3d8f0) switched from CREATED to
SCHEDULED.
2022-02-18 11:15:27,119 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Flat Map ->
Sink: Print to Std. Out (1/1) (d4030ce57c503099f4c50540d937615d) switched from
CREATED to SCHEDULED.
2022-02-18 11:15:27,130 INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve
slot request, no ResourceManager connected. Adding as pending request
[SlotRequestId{38076a3beb9e59686d6c3dfaae3fe1be}]
2022-02-18 11:15:27,139 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Connecting to ResourceManager
akka.tcp://[email protected]:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000)
2022-02-18 11:15:27,189 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Resolved ResourceManager address, beginning registration
2022-02-18 11:15:27,191 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Registering job manager
[email protected]://[email protected]:6123/user/rpc/jobmanager_2
for job 33257747ba7dc208df7db2707841aef9.
2022-02-18 11:15:27,196 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Registered job manager
[email protected]://[email protected]:6123/user/rpc/jobmanager_2
for job 33257747ba7dc208df7db2707841aef9.
2022-02-18 11:15:27,202 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - JobManager successfully registered at ResourceManager, leader
id: 00000000000000000000000000000000.
2022-02-18 11:15:27,207 INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting
new slot [SlotRequestId{38076a3beb9e59686d6c3dfaae3fe1be}] and profile
ResourceProfile{UNKNOWN} with allocation id bb2c8b1c66263fcfef71e36b109a1645
from resource manager.
2022-02-18 11:15:27,208 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Request slot with profile ResourceProfile{UNKNOWN} for job
33257747ba7dc208df7db2707841aef9 with allocation id
bb2c8b1c66263fcfef71e36b109a1645.
2022-02-18 11:15:27,211 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Requesting new worker with resource spec WorkerResourceSpec {cpuCores=0.5,
taskHeapSize=25.600mb (26843542 bytes), taskOffHeapSize=0 bytes,
networkMemSize=64.000mb (67108864 bytes), managedMemSize=230.400mb (241591914
bytes)}, current pending count: 1.
2022-02-18 11:15:27,218 INFO
org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled
external resources: []
2022-02-18 11:15:27,415 INFO
org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] - Creating new
TaskManager pod with name state-machine-cluster-taskmanager-2-1 and resource
<1024,0.5>.
2022-02-18 11:15:27,706 INFO
org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] - Pod
state-machine-cluster-taskmanager-2-1 is created.
2022-02-18 11:15:27,709 INFO
org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] - Received new
TaskManager pod: state-machine-cluster-taskmanager-2-1
2022-02-18 11:15:27,709 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Requested worker state-machine-cluster-taskmanager-2-1 with resource spec
WorkerResourceSpec {cpuCores=0.5, taskHeapSize=25.600mb (26843542 bytes),
taskOffHeapSize=0 bytes, networkMemSize=64.000mb (67108864 bytes),
managedMemSize=230.400mb (241591914 bytes)}.
2022-02-18 11:15:27,897 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
33257747ba7dc208df7db2707841aef9 is not in state RUNNING but SCHEDULED instead.
Aborting checkpoint.
2022-02-18 11:15:29,894 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
33257747ba7dc208df7db2707841aef9 is not in state RUNNING but SCHEDULED instead.
Aborting checkpoint.
2022-02-18 11:15:31,894 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
33257747ba7dc208df7db2707841aef9 is not in state RUNNING but SCHEDULED instead.
Aborting checkpoint.
2022-02-18 11:15:33,894 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
33257747ba7dc208df7db2707841aef9 is not in state RUNNING but SCHEDULED instead.
Aborting checkpoint.
2022-02-18 11:15:35,895 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
33257747ba7dc208df7db2707841aef9 is not in state RUNNING but SCHEDULED instead.
Aborting checkpoint.
2022-02-18 11:15:37,895 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
33257747ba7dc208df7db2707841aef9 is not in state RUNNING but SCHEDULED instead.
Aborting checkpoint.
2022-02-18 11:15:39,894 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
33257747ba7dc208df7db2707841aef9 is not in state RUNNING but SCHEDULED instead.
Aborting checkpoint.
2022-02-18 11:15:41,894 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
33257747ba7dc208df7db2707841aef9 is not in state RUNNING but SCHEDULED instead.
Aborting checkpoint.
2022-02-18 11:15:43,894 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
33257747ba7dc208df7db2707841aef9 is not in state RUNNING but SCHEDULED instead.
Aborting checkpoint.
2022-02-18 11:15:44,074 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Registering TaskManager with ResourceID state-machine-cluster-taskmanager-2-1
(akka.tcp://[email protected]:6122/user/rpc/taskmanager_0) at ResourceManager
2022-02-18 11:15:44,088 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Registering TaskManager with ResourceID state-machine-cluster-taskmanager-2-1
(akka.tcp://[email protected]:6122/user/rpc/taskmanager_0) at ResourceManager
2022-02-18 11:15:44,184 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Worker state-machine-cluster-taskmanager-2-1 is registered.
2022-02-18 11:15:44,185 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Worker state-machine-cluster-taskmanager-2-1 with resource spec
WorkerResourceSpec {cpuCores=0.5, taskHeapSize=25.600mb (26843542 bytes),
taskOffHeapSize=0 bytes, networkMemSize=64.000mb (67108864 bytes),
managedMemSize=230.400mb (241591914 bytes)} was requested in current attempt.
Current pending count after registering: 0.
2022-02-18 11:15:44,494 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
Custom Source (1/1) (546facd30c896ab8b37be2495ba3d8f0) switched from SCHEDULED
to DEPLOYING.
2022-02-18 11:15:44,494 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying
Source: Custom Source (1/1) (attempt #0) with attempt id
546facd30c896ab8b37be2495ba3d8f0 to state-machine-cluster-taskmanager-2-1 @
10.74.2.231 (dataPort=44531) with allocation id bb2c8b1c66263fcfef71e36b109a1645
2022-02-18 11:15:44,501 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Flat Map ->
Sink: Print to Std. Out (1/1) (d4030ce57c503099f4c50540d937615d) switched from
SCHEDULED to DEPLOYING.
2022-02-18 11:15:44,501 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying
Flat Map -> Sink: Print to Std. Out (1/1) (attempt #0) with attempt id
d4030ce57c503099f4c50540d937615d to state-machine-cluster-taskmanager-2-1 @
10.74.2.231 (dataPort=44531) with allocation id bb2c8b1c66263fcfef71e36b109a1645
2022-02-18 11:15:45,894 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
33257747ba7dc208df7db2707841aef9 is not in state RUNNING but DEPLOYING instead.
Aborting checkpoint.
2022-02-18 11:15:47,894 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint
triggering task Source: Custom Source (1/1) of job
33257747ba7dc208df7db2707841aef9 is not in state RUNNING but DEPLOYING instead.
Aborting checkpoint.
2022-02-18 11:15:48,477 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
Custom Source (1/1) (546facd30c896ab8b37be2495ba3d8f0) switched from DEPLOYING
to RUNNING.
2022-02-18 11:15:48,487 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Flat Map ->
Sink: Print to Std. Out (1/1) (d4030ce57c503099f4c50540d937615d) switched from
DEPLOYING to RUNNING.
2022-02-18 11:15:49,914 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 1 (type=CHECKPOINT) @ 1645182949895 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:15:52,825 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 1 for job 33257747ba7dc208df7db2707841aef9 (8916 bytes in 2927 ms).
2022-02-18 11:15:52,831 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 2 (type=CHECKPOINT) @ 1645182952826 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:15:53,275 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 2 for job 33257747ba7dc208df7db2707841aef9 (15716 bytes in 448 ms).
2022-02-18 11:15:53,901 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 3 (type=CHECKPOINT) @ 1645182953894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:15:54,015 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 3 for job 33257747ba7dc208df7db2707841aef9 (19851 bytes in 108 ms).
2022-02-18 11:15:55,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 4 (type=CHECKPOINT) @ 1645182955894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:15:56,356 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 4 for job 33257747ba7dc208df7db2707841aef9 (24865 bytes in 455 ms).
2022-02-18 11:15:57,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 5 (type=CHECKPOINT) @ 1645182957894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:15:58,406 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 5 for job 33257747ba7dc208df7db2707841aef9 (32799 bytes in 505 ms).
2022-02-18 11:15:58,628 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Registering TaskManager with ResourceID state-machine-cluster-taskmanager-1-2
(akka.tcp://[email protected]:6122/user/rpc/taskmanager_0) at ResourceManager
2022-02-18 11:15:58,633 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Worker state-machine-cluster-taskmanager-1-2 is registered.
2022-02-18 11:15:59,900 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 6 (type=CHECKPOINT) @ 1645182959894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:00,356 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 6 for job 33257747ba7dc208df7db2707841aef9 (25112 bytes in 453 ms).
2022-02-18 11:16:01,900 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 7 (type=CHECKPOINT) @ 1645182961894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:02,352 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 7 for job 33257747ba7dc208df7db2707841aef9 (25405 bytes in 451 ms).
2022-02-18 11:16:03,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 8 (type=CHECKPOINT) @ 1645182963894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:04,347 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 8 for job 33257747ba7dc208df7db2707841aef9 (25281 bytes in 445 ms).
2022-02-18 11:16:05,900 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 9 (type=CHECKPOINT) @ 1645182965894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:06,344 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 9 for job 33257747ba7dc208df7db2707841aef9 (33591 bytes in 444 ms).
2022-02-18 11:16:07,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 10 (type=CHECKPOINT) @ 1645182967894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:08,346 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 10 for job 33257747ba7dc208df7db2707841aef9 (25448 bytes in 444 ms).
2022-02-18 11:16:09,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 11 (type=CHECKPOINT) @ 1645182969894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:09,942 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 11 for job 33257747ba7dc208df7db2707841aef9 (25411 bytes in 41 ms).
2022-02-18 11:16:11,900 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 12 (type=CHECKPOINT) @ 1645182971894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:12,353 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 12 for job 33257747ba7dc208df7db2707841aef9 (25633 bytes in 451 ms).
2022-02-18 11:16:13,900 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 13 (type=CHECKPOINT) @ 1645182973894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:14,772 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 13 for job 33257747ba7dc208df7db2707841aef9 (33757 bytes in 869 ms).
2022-02-18 11:16:15,900 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 14 (type=CHECKPOINT) @ 1645182975894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:16,346 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 14 for job 33257747ba7dc208df7db2707841aef9 (26038 bytes in 445 ms).
2022-02-18 11:16:17,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 15 (type=CHECKPOINT) @ 1645182977895 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:18,350 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 15 for job 33257747ba7dc208df7db2707841aef9 (26137 bytes in 448 ms).
2022-02-18 11:16:19,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 16 (type=CHECKPOINT) @ 1645182979894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:19,951 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 16 for job 33257747ba7dc208df7db2707841aef9 (26045 bytes in 51 ms).
2022-02-18 11:16:21,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 17 (type=CHECKPOINT) @ 1645182981894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:22,355 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 17 for job 33257747ba7dc208df7db2707841aef9 (34251 bytes in 453 ms).
2022-02-18 11:16:23,900 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 18 (type=CHECKPOINT) @ 1645182983894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:24,356 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 18 for job 33257747ba7dc208df7db2707841aef9 (26106 bytes in 454 ms).
2022-02-18 11:16:25,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 19 (type=CHECKPOINT) @ 1645182985895 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:26,753 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 19 for job 33257747ba7dc208df7db2707841aef9 (26159 bytes in 846 ms).
2022-02-18 11:16:27,900 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 20 (type=CHECKPOINT) @ 1645182987894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:28,352 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 20 for job 33257747ba7dc208df7db2707841aef9 (25988 bytes in 452 ms).
2022-02-18 11:16:29,901 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 21 (type=CHECKPOINT) @ 1645182989895 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:30,360 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 21 for job 33257747ba7dc208df7db2707841aef9 (34223 bytes in 458 ms).
2022-02-18 11:16:31,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 22 (type=CHECKPOINT) @ 1645182991894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:32,348 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 22 for job 33257747ba7dc208df7db2707841aef9 (26348 bytes in 448 ms).
2022-02-18 11:16:33,900 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 23 (type=CHECKPOINT) @ 1645182993894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:34,348 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 23 for job 33257747ba7dc208df7db2707841aef9 (26488 bytes in 447 ms).
2022-02-18 11:16:35,900 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 24 (type=CHECKPOINT) @ 1645182995895 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:36,351 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 24 for job 33257747ba7dc208df7db2707841aef9 (26670 bytes in 449 ms).
2022-02-18 11:16:37,898 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 25 (type=CHECKPOINT) @ 1645182997894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:38,340 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 25 for job 33257747ba7dc208df7db2707841aef9 (34903 bytes in 438 ms).
2022-02-18 11:16:39,898 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 26 (type=CHECKPOINT) @ 1645182999894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:40,343 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 26 for job 33257747ba7dc208df7db2707841aef9 (26747 bytes in 442 ms).
2022-02-18 11:16:41,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 27 (type=CHECKPOINT) @ 1645183001894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:42,343 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 27 for job 33257747ba7dc208df7db2707841aef9 (26772 bytes in 443 ms).
2022-02-18 11:16:43,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 28 (type=CHECKPOINT) @ 1645183003895 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:43,979 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 28 for job 33257747ba7dc208df7db2707841aef9 (26873 bytes in 76 ms).
2022-02-18 11:16:45,900 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 29 (type=CHECKPOINT) @ 1645183005895 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:46,340 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 29 for job 33257747ba7dc208df7db2707841aef9 (34952 bytes in 439 ms).
2022-02-18 11:16:47,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 30 (type=CHECKPOINT) @ 1645183007894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:48,345 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 30 for job 33257747ba7dc208df7db2707841aef9 (26883 bytes in 445 ms).
2022-02-18 11:16:49,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 31 (type=CHECKPOINT) @ 1645183009894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:50,346 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 31 for job 33257747ba7dc208df7db2707841aef9 (27063 bytes in 446 ms).
2022-02-18 11:16:51,900 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 32 (type=CHECKPOINT) @ 1645183011895 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:52,350 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 32 for job 33257747ba7dc208df7db2707841aef9 (27053 bytes in 448 ms).
2022-02-18 11:16:53,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 33 (type=CHECKPOINT) @ 1645183013894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:54,346 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 33 for job 33257747ba7dc208df7db2707841aef9 (35361 bytes in 446 ms).
2022-02-18 11:16:55,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 34 (type=CHECKPOINT) @ 1645183015894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:56,347 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 34 for job 33257747ba7dc208df7db2707841aef9 (27167 bytes in 446 ms).
2022-02-18 11:16:57,898 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 35 (type=CHECKPOINT) @ 1645183017894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:58,343 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 35 for job 33257747ba7dc208df7db2707841aef9 (26833 bytes in 443 ms).
2022-02-18 11:16:59,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 36 (type=CHECKPOINT) @ 1645183019894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:16:59,956 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 36 for job 33257747ba7dc208df7db2707841aef9 (27284 bytes in 56 ms).
2022-02-18 11:17:01,902 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 37 (type=CHECKPOINT) @ 1645183021895 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:02,351 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 37 for job 33257747ba7dc208df7db2707841aef9 (35790 bytes in 448 ms).
2022-02-18 11:17:03,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 38 (type=CHECKPOINT) @ 1645183023894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:04,348 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 38 for job 33257747ba7dc208df7db2707841aef9 (27748 bytes in 447 ms).
2022-02-18 11:17:05,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 39 (type=CHECKPOINT) @ 1645183025894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:06,346 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 39 for job 33257747ba7dc208df7db2707841aef9 (27691 bytes in 446 ms).
2022-02-18 11:17:07,141 INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Releasing
idle slot [c80f00f2e5c7ddd9050c3c7f3b10adc8].
2022-02-18 11:17:07,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 40 (type=CHECKPOINT) @ 1645183027894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:07,952 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 40 for job 33257747ba7dc208df7db2707841aef9 (27022 bytes in 50 ms).
2022-02-18 11:17:09,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 41 (type=CHECKPOINT) @ 1645183029894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:10,348 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 41 for job 33257747ba7dc208df7db2707841aef9 (35699 bytes in 446 ms).
2022-02-18 11:17:11,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 42 (type=CHECKPOINT) @ 1645183031894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:12,352 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 42 for job 33257747ba7dc208df7db2707841aef9 (28073 bytes in 451 ms).
2022-02-18 11:17:13,898 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 43 (type=CHECKPOINT) @ 1645183033894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:14,344 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 43 for job 33257747ba7dc208df7db2707841aef9 (27994 bytes in 443 ms).
2022-02-18 11:17:15,898 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 44 (type=CHECKPOINT) @ 1645183035894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:16,342 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 44 for job 33257747ba7dc208df7db2707841aef9 (28062 bytes in 442 ms).
2022-02-18 11:17:17,898 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 45 (type=CHECKPOINT) @ 1645183037894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:18,338 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 45 for job 33257747ba7dc208df7db2707841aef9 (36463 bytes in 438 ms).
2022-02-18 11:17:19,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 46 (type=CHECKPOINT) @ 1645183039894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:20,339 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 46 for job 33257747ba7dc208df7db2707841aef9 (28136 bytes in 439 ms).
2022-02-18 11:17:21,898 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 47 (type=CHECKPOINT) @ 1645183041894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:22,341 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 47 for job 33257747ba7dc208df7db2707841aef9 (28690 bytes in 440 ms).
2022-02-18 11:17:23,898 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 48 (type=CHECKPOINT) @ 1645183043894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:23,940 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 48 for job 33257747ba7dc208df7db2707841aef9 (28465 bytes in 40 ms).
2022-02-18 11:17:25,898 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 49 (type=CHECKPOINT) @ 1645183045894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:26,345 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 49 for job 33257747ba7dc208df7db2707841aef9 (36992 bytes in 443 ms).
2022-02-18 11:17:27,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 50 (type=CHECKPOINT) @ 1645183047894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:28,343 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 50 for job 33257747ba7dc208df7db2707841aef9 (28248 bytes in 442 ms).
2022-02-18 11:17:29,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 51 (type=CHECKPOINT) @ 1645183049894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:30,396 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 51 for job 33257747ba7dc208df7db2707841aef9 (28824 bytes in 495 ms).
2022-02-18 11:17:31,900 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 52 (type=CHECKPOINT) @ 1645183051894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:32,344 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 52 for job 33257747ba7dc208df7db2707841aef9 (28627 bytes in 444 ms).
2022-02-18 11:17:33,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 53 (type=CHECKPOINT) @ 1645183053894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:34,343 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 53 for job 33257747ba7dc208df7db2707841aef9 (36693 bytes in 444 ms).
2022-02-18 11:17:35,898 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 54 (type=CHECKPOINT) @ 1645183055894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:36,337 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 54 for job 33257747ba7dc208df7db2707841aef9 (28950 bytes in 438 ms).
2022-02-18 11:17:37,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 55 (type=CHECKPOINT) @ 1645183057894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:38,340 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 55 for job 33257747ba7dc208df7db2707841aef9 (29081 bytes in 439 ms).
2022-02-18 11:17:39,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 56 (type=CHECKPOINT) @ 1645183059894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:40,342 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 56 for job 33257747ba7dc208df7db2707841aef9 (29195 bytes in 442 ms).
2022-02-18 11:17:41,898 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 57 (type=CHECKPOINT) @ 1645183061894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:42,340 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 57 for job 33257747ba7dc208df7db2707841aef9 (37498 bytes in 440 ms).
2022-02-18 11:17:43,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 58 (type=CHECKPOINT) @ 1645183063894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:43,941 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 58 for job 33257747ba7dc208df7db2707841aef9 (28928 bytes in 41 ms).
2022-02-18 11:17:45,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 59 (type=CHECKPOINT) @ 1645183065895 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:46,481 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 59 for job 33257747ba7dc208df7db2707841aef9 (29103 bytes in 578 ms).
2022-02-18 11:17:47,898 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 60 (type=CHECKPOINT) @ 1645183067895 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:48,339 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 60 for job 33257747ba7dc208df7db2707841aef9 (29324 bytes in 439 ms).
2022-02-18 11:17:49,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 61 (type=CHECKPOINT) @ 1645183069894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:50,403 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 61 for job 33257747ba7dc208df7db2707841aef9 (37576 bytes in 503 ms).
2022-02-18 11:17:51,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 62 (type=CHECKPOINT) @ 1645183071894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:52,340 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 62 for job 33257747ba7dc208df7db2707841aef9 (29668 bytes in 439 ms).
2022-02-18 11:17:53,900 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 63 (type=CHECKPOINT) @ 1645183073894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:54,344 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 63 for job 33257747ba7dc208df7db2707841aef9 (29375 bytes in 445 ms).
2022-02-18 11:17:55,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 64 (type=CHECKPOINT) @ 1645183075894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:55,938 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 64 for job 33257747ba7dc208df7db2707841aef9 (29938 bytes in 39 ms).
2022-02-18 11:17:56,211 INFO
org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] - Stopping
TaskManager pod state-machine-cluster-taskmanager-1-2.
2022-02-18 11:17:56,212 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Stopping worker state-machine-cluster-taskmanager-1-2.
2022-02-18 11:17:56,213 WARN
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Closing TaskExecutor connection state-machine-cluster-taskmanager-1-2 because:
TaskExecutor exceeded the idle timeout.
2022-02-18 11:17:56,232 WARN
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Discard registration from TaskExecutor state-machine-cluster-taskmanager-1-2 at
(akka.tcp://[email protected]:6122/user/rpc/taskmanager_0) because the
framework did not recognize it
2022-02-18 11:17:56,643 WARN akka.remote.ReliableDeliverySupervisor
[] - Association with remote system
[akka.tcp://[email protected]:6122] has failed, address is now gated for [50]
ms. Reason: [Disassociated]
2022-02-18 11:17:56,643 WARN akka.remote.ReliableDeliverySupervisor
[] - Association with remote system
[akka.tcp://[email protected]:43001] has failed, address is now gated
for [50] ms. Reason: [Disassociated]
2022-02-18 11:17:57,900 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 65 (type=CHECKPOINT) @ 1645183077896 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:17:58,342 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 65 for job 33257747ba7dc208df7db2707841aef9 (37800 bytes in 439 ms).
2022-02-18 11:17:59,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 66 (type=CHECKPOINT) @ 1645183079894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:18:00,341 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 66 for job 33257747ba7dc208df7db2707841aef9 (29897 bytes in 441 ms).
2022-02-18 11:18:01,898 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 67 (type=CHECKPOINT) @ 1645183081894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:18:02,366 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 67 for job 33257747ba7dc208df7db2707841aef9 (29757 bytes in 465 ms).
2022-02-18 11:18:03,899 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 68 (type=CHECKPOINT) @ 1645183083894 for job
33257747ba7dc208df7db2707841aef9.
2022-02-18 11:18:04,772 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 68 for job 33257747ba7dc208df7db2707841aef9 (30070 bytes in 872 ms).
2022-02-18 11:18:05,900 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 69 (type=CHECKPOINT) @ 1645183085894 for job
33257747ba7dc208df7db2707841aef9.
{code}
it will start a new TM, then release the old TM. it seems that the ha
config(zk) is not work
> flink job not recover from latest checkpoint on native k8s
> ----------------------------------------------------------
>
> Key: FLINK-26248
> URL: https://issues.apache.org/jira/browse/FLINK-26248
> Project: Flink
> Issue Type: Bug
> Components: Deployment / Kubernetes
> Affects Versions: 1.12.0
> Reporter: zhisheng
> Priority: Major
>
> flink version: 1.12.0
> ha: zk
> mode: application mode
> native k8s
>
> flink job start with savepoint, running for a while，then i delete the JM pod,
> the job will restart with the old savepoint not the latest checkpoint. this
> is not what i want
> if i delete the TM pod, the job will restart with the latest the
> checkpoint，this is what i want
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
