luckydarnell opened a new issue, #108:
URL: https://github.com/apache/rocketmq-flink/issues/108
environment:
java version "1.8.0_271" + flink-1.14.6 + rocketmq 4.9.2
exception infos:
2024-01-05 13:48:01,579 INFO
org.apache.rocketmq.flink.source.enumerator.RocketMQSourceEnumerator [] -
Starting the RocketMQSourceEnumerator for consumer group
AC_REPTILE-T_AC_RE_WZ_JJJZ without periodic partition discovery.
2024-01-05 13:48:01,589 INFO
org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source
Source: T_AC_RE_WZ_JJJZ(MQ)- registering reader for parallel task 0 @ 127.0.0.1
2024-01-05 13:48:01,886 INFO RocketmqRemoting
[] - closeChannel: close the connection to remote
address[10.200.38.118:9876] result: true
2024-01-05 13:48:01,887 INFO RocketmqRemoting
[] - closeChannel: close the connection to remote
address[10.200.38.118:9876] result: true
2024-01-05 13:48:01,889 INFO RocketmqRemoting
[] - closeChannel: close the connection to remote
address[10.200.38.118:9876] result: true
2024-01-05 13:48:01,889 INFO RocketmqRemoting
[] - closeChannel: close the connection to remote
address[10.200.38.118:9876] result: true
2024-01-05 13:48:01,890 INFO RocketmqRemoting
[] - closeChannel: close the connection to remote
address[10.200.38.118:9876] result: true
2024-01-05 13:48:01,887 ERROR
org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext [] -
Exception while handling result from async call in SourceCoordinator-Source:
T_AC_RE_WZ_JJJZ(MQ)-. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to handle partition
splits change due to
at
org.apache.rocketmq.flink.source.enumerator.RocketMQSourceEnumerator.handlePartitionSplitChanges(RocketMQSourceEnumerator.java:279)
~[flink-rocketmq-1.0-SNAPSHOT.jar:?]
at
org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$1(ExecutorNotifier.java:83)
~[flink-runtime-1.14.6.jar:1.14.6]
at
org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
[flink-core-1.14.6.jar:1.14.6]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
[?:1.8.0_271]
at java.util.concurrent.FutureTask.run(Unknown Source) [?:1.8.0_271]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(Unknown
Source) [?:1.8.0_271]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown
Source) [?:1.8.0_271]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
[?:1.8.0_271]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
[?:1.8.0_271]
at java.lang.Thread.run(Unknown Source) [?:1.8.0_271]
Caused by: org.apache.rocketmq.client.exception.MQClientException: Can not
find Message Queue for this topic, FPC_SYNC_FI_AC_REPTILE_1
See http://rocketmq.apache.org/docs/faq/ for further details.
at
org.apache.rocketmq.client.impl.MQAdminImpl.fetchSubscribeMessageQueues(MQAdminImpl.java:177)
~[rocketmq-client-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.client.impl.consumer.DefaultMQPullConsumerImpl.fetchSubscribeMessageQueues(DefaultMQPullConsumerImpl.java:147)
~[rocketmq-client-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.client.consumer.DefaultMQPullConsumer.fetchSubscribeMessageQueues(DefaultMQPullConsumer.java:290)
~[rocketmq-client-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.flink.source.enumerator.RocketMQSourceEnumerator.discoverAndInitializePartitionSplit(RocketMQSourceEnumerator.java:248)
~[flink-rocketmq-1.0-SNAPSHOT.jar:?]
at
org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$2(ExecutorNotifier.java:80)
~[flink-runtime-1.14.6.jar:1.14.6]
... 7 more
Caused by:
org.apache.rocketmq.remoting.exception.RemotingSendRequestException: send
request to <10.200.38.118:9876> failed
at
org.apache.rocketmq.remoting.netty.NettyRemotingAbstract.invokeSyncImpl(NettyRemotingAbstract.java:440)
~[rocketmq-remoting-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.remoting.netty.NettyRemotingClient.invokeSync(NettyRemotingClient.java:377)
~[rocketmq-remoting-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.client.impl.MQClientAPIImpl.getTopicRouteInfoFromNameServer(MQClientAPIImpl.java:1367)
~[rocketmq-client-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.client.impl.MQClientAPIImpl.getTopicRouteInfoFromNameServer(MQClientAPIImpl.java:1357)
~[rocketmq-client-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.client.impl.MQAdminImpl.fetchSubscribeMessageQueues(MQAdminImpl.java:166)
~[rocketmq-client-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.client.impl.consumer.DefaultMQPullConsumerImpl.fetchSubscribeMessageQueues(DefaultMQPullConsumerImpl.java:147)
~[rocketmq-client-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.client.consumer.DefaultMQPullConsumer.fetchSubscribeMessageQueues(DefaultMQPullConsumer.java:290)
~[rocketmq-client-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.flink.source.enumerator.RocketMQSourceEnumerator.discoverAndInitializePartitionSplit(RocketMQSourceEnumerator.java:248)
~[flink-rocketmq-1.0-SNAPSHOT.jar:?]
at
org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$2(ExecutorNotifier.java:80)
~[flink-runtime-1.14.6.jar:1.14.6]
... 7 more
2024-01-05 13:48:01,898 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by
OperatorCoordinator for 'Source: T_AC_RE_WZ_JJJZ(MQ)- ->
trans-before-WzJjjz-FILTER -> exceptHandle -> trans-before-WzJjjz-FIELD ->
exceptHandle' (operator 01ec4bd87bc398b2562c171201d1e9f6).
at
org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:545)
~[flink-runtime-1.14.6.jar:1.14.6]
at
org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:231)
~[flink-runtime-1.14.6.jar:1.14.6]
at
org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:299)
~[flink-runtime-1.14.6.jar:1.14.6]
at
org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:312)
~[flink-runtime-1.14.6.jar:1.14.6]
at
org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
~[flink-core-1.14.6.jar:1.14.6]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
~[?:1.8.0_271]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:1.8.0_271]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(Unknown
Source) ~[?:1.8.0_271]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown
Source) ~[?:1.8.0_271]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
~[?:1.8.0_271]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
~[?:1.8.0_271]
at java.lang.Thread.run(Unknown Source) ~[?:1.8.0_271]
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to handle
partition splits change due to
at
org.apache.rocketmq.flink.source.enumerator.RocketMQSourceEnumerator.handlePartitionSplitChanges(RocketMQSourceEnumerator.java:279)
~[flink-rocketmq-1.0-SNAPSHOT.jar:?]
at
org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$1(ExecutorNotifier.java:83)
~[flink-runtime-1.14.6.jar:1.14.6]
at
org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
~[flink-core-1.14.6.jar:1.14.6]
... 7 more
Caused by: org.apache.rocketmq.client.exception.MQClientException: Can not
find Message Queue for this topic, FPC_SYNC_FI_AC_REPTILE_1
See http://rocketmq.apache.org/docs/faq/ for further details.
at
org.apache.rocketmq.client.impl.MQAdminImpl.fetchSubscribeMessageQueues(MQAdminImpl.java:177)
~[rocketmq-client-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.client.impl.consumer.DefaultMQPullConsumerImpl.fetchSubscribeMessageQueues(DefaultMQPullConsumerImpl.java:147)
~[rocketmq-client-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.client.consumer.DefaultMQPullConsumer.fetchSubscribeMessageQueues(DefaultMQPullConsumer.java:290)
~[rocketmq-client-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.flink.source.enumerator.RocketMQSourceEnumerator.discoverAndInitializePartitionSplit(RocketMQSourceEnumerator.java:248)
~[flink-rocketmq-1.0-SNAPSHOT.jar:?]
at
org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$2(ExecutorNotifier.java:80)
~[flink-runtime-1.14.6.jar:1.14.6]
... 7 more
Caused by:
org.apache.rocketmq.remoting.exception.RemotingSendRequestException: send
request to <10.200.38.118:9876> failed
at
org.apache.rocketmq.remoting.netty.NettyRemotingAbstract.invokeSyncImpl(NettyRemotingAbstract.java:440)
~[rocketmq-remoting-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.remoting.netty.NettyRemotingClient.invokeSync(NettyRemotingClient.java:377)
~[rocketmq-remoting-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.client.impl.MQClientAPIImpl.getTopicRouteInfoFromNameServer(MQClientAPIImpl.java:1367)
~[rocketmq-client-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.client.impl.MQClientAPIImpl.getTopicRouteInfoFromNameServer(MQClientAPIImpl.java:1357)
~[rocketmq-client-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.client.impl.MQAdminImpl.fetchSubscribeMessageQueues(MQAdminImpl.java:166)
~[rocketmq-client-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.client.impl.consumer.DefaultMQPullConsumerImpl.fetchSubscribeMessageQueues(DefaultMQPullConsumerImpl.java:147)
~[rocketmq-client-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.client.consumer.DefaultMQPullConsumer.fetchSubscribeMessageQueues(DefaultMQPullConsumer.java:290)
~[rocketmq-client-4.9.2.jar:4.9.2]
at
org.apache.rocketmq.flink.source.enumerator.RocketMQSourceEnumerator.discoverAndInitializePartitionSplit(RocketMQSourceEnumerator.java:248)
~[flink-rocketmq-1.0-SNAPSHOT.jar:?]
at
org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$2(ExecutorNotifier.java:80)
~[flink-runtime-1.14.6.jar:1.14.6]
... 7 more
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
