lukeyan2023 opened a new issue, #5747:
URL: https://github.com/apache/seatunnel/issues/5747

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22)
 and found no similar issues.
   
   
   ### What happened
   
   Failed to read kafka according to the following official website example 
configuration, The situation is the same for local mode and cluster mode。 
Modify max. poll. records=500 to max. poll. records="500", and the task can run 
successfully
   
   
   
   # Defining the runtime environment
   env {
     # You can set flink configuration here
     execution.parallelism = 2
     job.mode = "BATCH"
   }
   source {
     Kafka {
       schema = {
         fields {
           name = "string"
           age = "int"
         }
       }
       format = text
       field_delimiter = "#"
       topic = "topic_1,topic_2,topic_3"
       bootstrap.servers = "localhost:9092"
       kafka.config = {
         client.id = client_1
         max.poll.records = 500
         auto.offset.reset = "earliest"
         enable.auto.commit = "false"
       }
     }  
   }
   sink {
     Console {}
   }
   
   ### SeaTunnel Version
   
   2.3.3
   
   ### SeaTunnel Config
   
   ```conf
   # Defining the runtime environment
   env {
     # You can set flink configuration here
     execution.parallelism = 2
     job.mode = "STREAMING"
   }
   source {
     Kafka {
       schema = {
         fields {
           message = "string"
           log = "string"
           input = "string"
           host = "string"
           agent = "string"
         }
       }
       format = json
       result_table_name
       topic = "ods_linux_syslog"
       bootstrap.servers = "localhost:9092"
       kafka.config = {
         client.id = client_1
         max.poll.records = 500
         auto.offset.reset = "earliest"
         enable.auto.commit = "false"
       }
     }  
   }
   
   sink {  
     Console {}  
   }
   ```
   
   
   ### Running Command
   
   ```shell
   # local mode
   ./seatunnel.sh --config test.conf -e local
   
   # cluster mode
   
   ./seatunnel.sh --config test.conf
   ```
   
   
   ### Error Exception
   
   ```log
   Exception in thread "main" 
org.apache.seatunnel.core.starter.exception.CommandExecuteException: SeaTunnel 
job executed failed
        at 
org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:191)
        at org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40)
        at 
org.apache.seatunnel.core.starter.seatunnel.SeaTunnelClient.main(SeaTunnelClient.java:34)
   Caused by: 
org.apache.seatunnel.engine.common.exception.SeaTunnelEngineException: 
java.util.concurrent.CompletionException: java.lang.NullPointerException: null 
value in entry: max.poll.records=null
        at 
java.util.concurrent.CompletableFuture.reportJoin(CompletableFuture.java:375)
        at 
java.util.concurrent.CompletableFuture.join(CompletableFuture.java:1947)
        at 
org.apache.seatunnel.connectors.seatunnel.kafka.source.KafkaSourceReader.lambda$pollNext$4(KafkaSourceReader.java:207)
        at java.lang.Iterable.forEach(Iterable.java:75)
        at 
org.apache.seatunnel.connectors.seatunnel.kafka.source.KafkaSourceReader.pollNext(KafkaSourceReader.java:119)
        at 
org.apache.seatunnel.engine.server.task.flow.SourceFlowLifeCycle.collect(SourceFlowLifeCycle.java:150)
        at 
org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.collect(SourceSeaTunnelTask.java:95)
        at 
org.apache.seatunnel.engine.server.task.SeaTunnelTask.stateProcess(SeaTunnelTask.java:168)
        at 
org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.call(SourceSeaTunnelTask.java:100)
        at 
org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:750)
   Caused by: java.lang.NullPointerException: null value in entry: 
max.poll.records=null
        at 
com.google.common.collect.CollectPreconditions.checkEntryNotNull(CollectPreconditions.java:32)
        at com.google.common.collect.ImmutableMap.entryOf(ImmutableMap.java:176)
        at 
com.google.common.collect.ImmutableMap$Builder.put(ImmutableMap.java:285)
        at com.google.common.collect.Maps.fromProperties(Maps.java:1362)
        at 
org.apache.seatunnel.connectors.seatunnel.kafka.source.KafkaSourceReader.lambda$null$3(KafkaSourceReader.java:135)
        at 
org.apache.seatunnel.connectors.seatunnel.kafka.source.KafkaConsumerThread.run(KafkaConsumerThread.java:58)
        ... 5 more
   
        at 
org.apache.seatunnel.engine.client.job.ClientJobProxy.waitForJobComplete(ClientJobProxy.java:122)
        at 
org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:184)
        ... 2 more
   ```
   
   
   ### Zeta or Flink or Spark Version
   
   Zeta
   
   ### Java or Scala Version
   
   1.8
   
   ### Screenshots
   
   
![image](https://github.com/apache/seatunnel/assets/108530647/10522888-af3c-4899-94de-866c8370d543)
   
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to