zengqinchris opened a new issue, #6006: URL: https://github.com/apache/seatunnel/issues/6006
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened 用 [earliest],[group_offsets],[latest],模式的批次，都无法消费输出数据，用监控消费者的offset是有变化的，就是没有数据输出 ### SeaTunnel Version dev ### SeaTunnel Config ```conf env { parallelism = 1 job.mode = "BATCH" checkpoint.interval = 900000 } source { Kafka { format = json field_delimiter = "," format_error_handle_way = "fail" topic = "kv_info" consumer.group = "kv_info_client_5" start_mode = "group_offsets" start_mode.offsets = { kv_info-0 = 100 } bootstrap.servers = "192.168.0.57:9092,192.168.0.252:9092,192.168.0.233:9092" result_table_name = "yundee_source0" kafka.config = { client.id = kv_info_client_5 max.poll.records = 50000 enable.auto.commit = "false" } } } transform { } sink { Console { } } ``` ### Running Command ```shell /opt/usdp-srv/srv/udp/2.0.0.0/seatunnel/bin/seatunnel.sh -c /home/hadoop/dengshi/t_ods_kv_info_log.conf ``` ### Error Exception ```log 数据有提示变动但是没有数据输出 t as ["string1","string2"]; we will only use ',' to split the String into a list. 2023-12-14 11:08:09,614 INFO [.s.p.d.AbstractPluginDiscovery] [main] - Load SeaTunnelSink Plugin from /bigdata/usdp-master/srv/udp/2.0.0.0/seatunnel/connectors 2023-12-14 11:08:09,614 INFO [.s.p.d.AbstractPluginDiscovery] [main] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='sink', pluginName='IcebergDeng'} at: file:/bigdata/usdp-master/srv/udp/2.0.0.0/seatunnel/connectors/connector-iceberg-2.3.4-SNAPSHOT.jar 2023-12-14 11:08:09,616 INFO [.s.p.d.AbstractPluginDiscovery] [main] - Load plugin: PluginIdentifier{engineType='seatunnel', pluginType='sink', pluginName='IcebergDeng'} from classpath 2023-12-14 11:08:09,660 INFO [o.a.s.e.c.j.ClientJobProxy ] [main] - Start submit job, job id: 787516183132766209, with plugin jar [file:/bigdata/usdp-master/srv/udp/2.0.0.0/seatunnel/connectors/connector-iceberg-2.3.4-SNAPSHOT.jar, file:/bigdata/usdp-master/srv/udp/2.0.0.0/seatunnel/connectors/connector-kafka-2.3.4-SNAPSHOT.jar] 2023-12-14 11:08:09,688 INFO [o.a.s.e.c.j.ClientJobProxy ] [main] - Submit job finished, job id: 787516183132766209, job name: SeaTunnel 2023-12-14 11:08:09,699 WARN [o.a.s.e.c.j.JobMetricsRunner ] [job-metrics-runner-787516183132766209] - Failed to get job metrics summary, it maybe first-run 2023-12-14 11:09:09,704 INFO [o.a.s.e.c.j.JobMetricsRunner ] [job-metrics-runner-787516183132766209] - *********************************************** Job Progress Information *********************************************** Job Id : 787516183132766209 Read Count So Far : 37 Write Count So Far : 37 Average Read Count : 0/s Average Write Count : 0/s Last Statistic Time : 2023-12-14 11:08:09 Current Statistic Time : 2023-12-14 11:09:09 *********************************************** 2023-12-14 11:10:09,700 INFO [o.a.s.e.c.j.JobMetricsRunner ] [job-metrics-runner-787516183132766209] - *********************************************** Job Progress Information *********************************************** Job Id : 787516183132766209 Read Count So Far : 42 Write Count So Far : 42 Average Read Count : 0/s Average Write Count : 0/s Last Statistic Time : 2023-12-14 11:09:09 Current Statistic Time : 2023-12-14 11:10:09 *********************************************** 2023-12-14 11:11:09,698 INFO [o.a.s.e.c.j.JobMetricsRunner ] [job-metrics-runner-787516183132766209] - *********************************************** Job Progress Information *********************************************** Job Id : 787516183132766209 Read Count So Far : 45 Write Count So Far : 45 Average Read Count : 0/s Average Write Count : 0/s Last Statistic Time : 2023-12-14 11:10:09 Current Statistic Time : 2023-12-14 11:11:09 *********************************************** 2023-12-14 11:12:09,699 INFO [o.a.s.e.c.j.JobMetricsRunner ] [job-metrics-runner-787516183132766209] - *********************************************** Job Progress Information *********************************************** Job Id : 787516183132766209 Read Count So Far : 49 Write Count So Far : 49 Average Read Count : 0/s Average Write Count : 0/s Last Statistic Time : 2023-12-14 11:11:09 Current Statistic Time : 2023-12-14 11:12:09 *********************************************** 下面的是消费者的offset的变化 2023-12-14 11:11:04,025 INFO [o.a.k.c.c.KafkaConsumer ] [Kafka Source Data Consumer] - [Consumer clientId=kv_info_client_5, groupId=kv_info_client_5] Subscribed to partition(s): kv_info-0 2023-12-14 11:11:04,025 INFO [o.a.k.c.c.KafkaConsumer ] [Kafka Source Data Consumer] - [Consumer clientId=kv_info_client_5, groupId=kv_info_client_5] Seeking to offset 200 for partition kv_info-0 2023-12-14 11:11:10,166 INFO [o.a.k.c.c.KafkaConsumer ] [Kafka Source Data Consumer] - [Consumer clientId=kv_info_client_5, groupId=kv_info_client_5] Subscribed to partition(s): kv_info-0 2023-12-14 11:11:10,166 INFO [o.a.k.c.c.KafkaConsumer ] [Kafka Source Data Consumer] - [Consumer clientId=kv_info_client_5, groupId=kv_info_client_5] Seeking to offset 201 for partition kv_info-0 2023-12-14 11:11:19,286 INFO [o.a.k.c.c.KafkaConsumer ] [Kafka Source Data Consumer] - [Consumer clientId=kv_info_client_5, groupId=kv_info_client_5] Subscribed to partition(s): kv_info-0 2023-12-14 11:11:19,286 INFO [o.a.k.c.c.KafkaConsumer ] [Kafka Source Data Consumer] - [Consumer clientId=kv_info_client_5, groupId=kv_info_client_5] Seeking to offset 202 for partition kv_info-0 2023-12-14 11:11:26,666 INFO [o.a.k.c.c.KafkaConsumer ] [Kafka Source Data Consumer] - [Consumer clientId=kv_info_client_5, groupId=kv_info_client_5] Subscribed to partition(s): kv_info-0 2023-12-14 11:11:26,666 INFO [o.a.k.c.c.KafkaConsumer ] [Kafka Source Data Consumer] - [Consumer clientId=kv_info_client_5, groupId=kv_info_client_5] Seeking to offset 203 for partition kv_info-0 2023-12-14 11:11:36,066 INFO [o.a.k.c.c.KafkaConsumer ] [Kafka Source Data Consumer] - [Consumer clientId=kv_info_client_5, groupId=kv_info_client_5] Subscribed to partition(s): kv_info-0 2023-12-14 11:11:36,066 INFO [o.a.k.c.c.KafkaConsumer ] [Kafka Source Data Consumer] - [Consumer clientId=kv_info_client_5, groupId=kv_info_client_5] Seeking to offset 204 for partition kv_info-0 2023-12-14 11:11:46,167 INFO [o.a.k.c.c.KafkaConsumer ] [Kafka Source Data Consumer] - [Consumer clientId=kv_info_client_5, groupId=kv_info_client_5] Subscribed to partition(s): kv_info-0 2023-12-14 11:11:46,167 INFO [o.a.k.c.c.KafkaConsumer ] [Kafka Source Data Consumer] - [Consumer clientId=kv_info_client_5, groupId=kv_info_client_5] Seeking to offset 204 for partition kv_info-0 2023-12-14 11:11:56,268 INFO [o.a.k.c.c.KafkaConsumer ] [Kafka Source Data Consumer] - [Consumer clientId=kv_info_client_5, groupId=kv_info_client_5] Subscribed to partition(s): kv_info-0 2023-12-14 11:11:56,268 INFO [o.a.k.c.c.KafkaConsumer ] [Kafka Source Data Consumer] - [Consumer clientId=kv_info_client_5, groupId=kv_info_client_5] Seeking to offset 204 for partition kv_info-0 2023-12-14 11:12:03,657 INFO [o.a.s.e.s.CoordinatorService ] [pool-5-thread-1] - [localhost]:5801 [seatunnel] [5.1] ``` ### Zeta or Flink or Spark Version Zeta ### Java or Scala Version jdk1.8 ### Screenshots  这个截图是 后端日志offset的变化 ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
