Hi, Tauseef.
This error is not that you can not access the Kafka cluster. Actually, this
error means that the JM cannot access its TM.
Have you ever checked whether the JM is able to access the TM?
Best,
Hang
Tauseef Janvekar <tauseefjanve...@gmail.com> 于2023年11月23日周四 16:04写道：
> Dear Team,
>
> We are facing the below issue while connecting to confluent kafka
> Can someone please help here.
>
> 2023-11-23 06:09:36,989 INFO org.apache.flink.runtime.executiongraph.
> ExecutionGraph [] - Source: src_source -> Sink: Print to Std. Out (1
> /1) (496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0)
> switched from SCHEDULED to DEPLOYING.
> 2023-11-23 06:09:36,994 INFO org.apache.flink.runtime.executiongraph.
> ExecutionGraph [] - Deploying Source: src_source -> Sink: Print to
> Std. Out (1/1) (attempt #0) with attempt id
> 496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0
> and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to flink-taskmanager:6122
> -23f057 @ flink-taskmanager.flink.svc.cluster.local (dataPort=46589) with
> allocation id 80fe79389102bd305dd87a00247413eb
> 2023-11-23 06:09:37,011 INFO
> org.apache.kafka.common.security.authenticator.AbstractLogin [] -
> Successfully logged in.
> 2023-11-23 06:09:37,109 WARN org.apache.kafka.clients.admin.
> AdminClientConfig [] - The configuration 'key.deserializer'
> was supplied but isn't a known config.
> 2023-11-23 06:09:37,109 WARN org.apache.kafka.clients.admin.
> AdminClientConfig [] - The configuration 'value.deserializer'
> was supplied but isn't a known config.
> 2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
> AdminClientConfig [] - The configuration 'client.id.prefix'
> was supplied but isn't a known config.
> 2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
> AdminClientConfig [] - The configuration '
> partition.discovery.interval.ms' was supplied but isn't a known config.
> 2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
> AdminClientConfig [] - The configuration
> 'commit.offsets.on.checkpoint' was supplied but isn't a known config.
> 2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
> AdminClientConfig [] - The configuration 'enable.auto.commit'
> was supplied but isn't a known config.
> 2023-11-23 06:09:37,111 WARN org.apache.kafka.clients.admin.
> AdminClientConfig [] - The configuration 'auto.offset.reset'
> was supplied but isn't a known config.
> 2023-11-23 06:09:37,113 INFO org.apache.kafka.common.utils.AppInfoParser
> [] - Kafka version: 3.2.2
> 2023-11-23 06:09:37,114 INFO org.apache.kafka.common.utils.AppInfoParser
> [] - Kafka commitId: 38c22ad893fb6cf5
> 2023-11-23 06:09:37,114 INFO org.apache.kafka.common.utils.AppInfoParser
> [] - Kafka startTimeMs: 1700719777111
> 2023-11-23 06:09:37,117 INFO
> org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator
> [] - Starting the KafkaSourceEnumerator for consumer group null without
> periodic partition discovery.
> 2023-11-23 06:09:37,199 INFO org.apache.flink.runtime.executiongraph.
> ExecutionGraph [] - Source: src_source -> Sink: Print to Std. Out (1
> /1) (496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0)
> switched from DEPLOYING to INITIALIZING.
> 2023-11-23 06:09:37,302 INFO org.apache.flink.runtime.source.coordinator.
> SourceCoordinator [] - Source Source: src_source registering reader for
> parallel task 0 (#0) @ flink-taskmanager
> 2023-11-23 06:09:37,313 INFO org.apache.flink.runtime.executiongraph.
> ExecutionGraph [] - Source: src_source -> Sink: Print to Std. Out (1
> /1) (496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0)
> switched from INITIALIZING to RUNNING.
> 2023-11-23 06:09:38,713 INFO
> org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator
> [] - Discovered new partitions: [aiops-3, aiops-2, aiops-1, aiops-0,
> aiops-5, aiops-4]
> 2023-11-23 06:09:38,719 INFO
> org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator
> [] - Assigning splits to readers {0=[[Partition: aiops-1, StartingOffset:
> -1, StoppingOffset: -9223372036854775808], [Partition: aiops-2,
> StartingOffset: -1, StoppingOffset: -9223372036854775808], [Partition:
> aiops-0, StartingOffset: -1, StoppingOffset: -9223372036854775808], [
> Partition: aiops-4, StartingOffset: -1, StoppingOffset: -
> 9223372036854775808], [Partition: aiops-3, StartingOffset: -1,
> StoppingOffset: -9223372036854775808], [Partition: aiops-5, StartingOffset:
> -1, StoppingOffset: -9223372036854775808]]}
> 2023-11-23 06:09:57,651 INFO akka.remote.transport.ProtocolStateActor
> [] - No response from remote for outbound association.
> Associate timed out after [20000 ms].
> 2023-11-23 06:09:57,651 WARN akka.remote.ReliableDeliverySupervisor
> [] - Association with remote system
> [akka.tcp://flink-metrics@flink-taskmanager:33837] has failed, address is
> now gated for [50] ms. Reason: [Association failed with
> [akka.tcp://flink-metrics@flink-taskmanager:33837]] Caused by: [No
> response from remote for outbound association. Associate timed out after [
> 20000 ms].]
> 2023-11-23 06:09:57,668 WARN akka.remote.transport.netty.NettyTransport
> [] - Remote connection to [null] failed with
> org.jboss.netty.channel.ConnectTimeoutException: connection timed out:
> flink-taskmanager/172.20.208.151:33837
> 2023-11-23 06:14:38,188 INFO org.apache.kafka.clients.NetworkClient
> [] - [AdminClient clientId=KafkaSource-
> 7770001137980494918-enumerator-admin-client] Node -1 disconnected.
> 2023-11-23 06:19:38,354 INFO org.apache.kafka.clients.NetworkClient
> [] - [AdminClient clientId=KafkaSource-
> 7770001137980494918-enumerator-admin-client] Node 9 disconnected.
> 2023-11-23 06:24:39,060 INFO org.apache.kafka.clients.NetworkClient
> [] - [AdminClient clientId=KafkaSource-
> 7770001137980494918-enumerator-admin-client] Node 6 disconnected.
> 2023-11-23 06:29:39,801 INFO org.apache.kafka.clients.NetworkClient
> [] - [AdminClient clientId=KafkaSource-
> 7770001137980494918-enumerator-admin-client] Node 8 disconnected.
> 2023-11-23 06:34:40,544 INFO org.apache.kafka.clients.NetworkClient
> [] - [AdminClient clientId=KafkaSource-
> 7770001137980494918-enumerator-admin-client] Node 13 disconnected.
> 2023-11-23 06:39:41,245 INFO org.apache.kafka.clients.NetworkClient
> [] - [AdminClient clientId=KafkaSource-
> 7770001137980494918-enumerator-admin-client] Node 3 disconnected.
> 2023-11-23 06:44:41,976 INFO org.apache.kafka.clients.NetworkClient
> [] - [AdminClient clientId=KafkaSource-
> 7770001137980494918-enumerator-admin-client] Node 2 disconnected.
>
>
> Thanks,
> Tauseef
>
